TWiki home TWiki.Tukro > TWiki > TWikiSiteTools (r1.1 vs. r1.8) TWiki.Tukro webs:
Main | TWiki | Know | Sandbox
TWiki . { Welcome | Register | Changes | Topics | Index | Search | Go }
 <<O>>  Difference Topic TWikiSiteTools (r1.8 - 25 Apr 2004 - PeterThoeny)
Line: 1 to 1
Changed:
<
<
META TOPICINFO PeterThoeny date="1043912580" format="1.0" version="1.7"
>
>
META TOPICINFO PeterThoeny date="1082851827" format="1.0" version="1.8"

TWiki Site Tools

Line: 44 to 44

For Unix platforms: Edit the cron table so that mailnotify is called in an interval of your choice. Please consult man crontab of how to modify the table that schedules program execution at certain intervals. Example:
% crontab -e
Changed:
<
<
15,45 * * * * (cd ~twiki/public_html/bin; ./mailnotify -q)
>
>
0 2 * * * (cd /path/to/twiki/bin; ./mailnotify -q)

Changed:
<
<
The above line will call mailnotify at 15 minutes and 45 minutes past every hour. The -q switch suppresses all normal output.
>
>
The above line will run mailnotify nightly at 02:00. The -q switch suppresses all normal output.

For ISP installations: Many ISPs don't allow hosted accounts direct cron access, as it's often used for things that can heavily load the server. Workaround scripts are available.

On Windows NT/2000: You can use a scheduled task if you have administrative privileges. Note: AT on an NT machine is pretty limited. Microsoft lists several third-party

Changed:
<
<
replacements (as of 2001-11-20, none of them free).
>
>
replacements. TWiki:Codev/CronTabWin is a free scheduler for Windows.

WebStatistics Site Usage Log

Line: 65 to 64

Configuring for Automatic Operation

  • You can automatically generate usage statistics for all webs. To enable this:
Changed:
<
<
    • Make sure variable $doLogTopicView, $doLogTopicSave and $doLogTopicUpload in TWiki.cfg are set. This will generate log entries in file twiki/data/log<date>.txt .
>
>
    • Make sure variable $doLogTopicView, $doLogTopicSave and $doLogTopicUpload in TWiki.cfg are set. This will generate log file entries (see below).

    • The WebStatistics topic must be present in all webs where you want to have statistics. You can use the topic in the Main web as a template.
    • Call the twiki/bin/statistics script from a cron job, once a day is recommended. This will update the WebStatistics topics in all webs.
Changed:
<
<
    • Attention: The script must run as the same user as the CGI scripts are running, which is user nobody on most systems. Example crontab entry:
      0 0 * * * (cd /path/to/TWiki/bin; ./statistics >/dev/null 2>&1)
>
>
    • Attention: The script must run as the same user as the CGI scripts are running, which is user nobody on many systems. Example crontab entry:
      0 0 * * * (cd /path/to/TWiki/bin; ./statistics >/dev/null 2>&1)

    • There is a workaround in case you can't run the script as user nobody : Run the utility twiki/bin/geturl in your cron job and specify the URL of the twiki/bin/statistics script as a parameter. Example:
      0 0 * * * (cd /path/to/TWiki/bin; ./geturl mydomain.com /urlpath/to/TWiki/bin/statistics >/dev/null 2>&1)

Generating Statistics Manually by URL

Line: 78 to 77

    • Update current month for Main web only:
      http://mydomain.com/twiki/bin/statistics/Main
    • Update January 2000 for Main web:
      http://mydomain.com/twiki/bin/statistics/Main?logdate=200001
Added:
>
>

Log File Details

TWiki generates monthly log files which are used by the statistics

  • The log directory is defined by the $logDir variable in TWiki.cfg
  • The file name is log<year><month>.txt
  • Example path name: twiki/data/log202412.txt
  • Each access gets logged as:
    | <time> | <wikiusername> | <action> | <web>.<topic> | <extra info> | <IP address> |
  • Example log entry:
    | 23 Dec 2024 - 15:19 | Main.TWikiGuest | view | TWiki.WebRss |  | 66.124.232.02 |
  • Actions are logged if enabled in TWiki.cfg by the $doLogTopic<action> flags
  • Logged actions:
    Script Action name Extra info down
    changes changes  
    rdiff rdiff 1.4 1.3
    register register E-mail address
    upload upload filename
    search search search string
    edit edit when editing non-existing topic: (not exist)
    rename move when moving attachment: Attachment filename moved to Newweb.NewTopic
    rename rename when moving topic: moved to Newweb.NewTopic
    save save when replacing existing revision: repRev 1.3
    when user checks the minor changes box: dontNotify
    attach attach when viewing attach screen of previous uploaded attachment: filename
    view view when viewing non-existing topic: (not exist)
    when viewing previous topic revision: r1.3

WebSearch

WebSearch is an extremely fast and flexible search facility, part of the core TWiki feature set. Options include:

Line: 109 to 134

Added:
>
>
-- TWiki:Main.MikeMannix - 01 Dec 2001
-- TWiki:Main.PeterThoeny - 24 Apr 2004

 <<O>>  Difference Topic TWikiSiteTools (r1.7 - 30 Jan 2003 - PeterThoeny)
Line: 1 to 1
Changed:
<
<
META TOPICINFO MikeMannix? date="1020528636" format="1.0" version="1.6"
>
>
META TOPICINFO PeterThoeny date="1043912580" format="1.0" version="1.7"

TOC: No TOC in "TWiki.TWikiSiteTools"
Changed:
<
<

TWikiSiteTools

>
>

TWiki Site Tools


Utilities for searching, navigation, and monitoring site activity

Line: 9 to 9

WebNotify Recent Changes Alert

Changed:
<
<
Each TWiki web has an automatic email alert service that sends a list of recent changes on a preset schedule, like once a day. Users can subscribe and unsubscribe using WebNotify in each web. The Perl script mailnotify is called by a deamon in regular intervals. The script sends an automated email to subscribed users if topics were changed in a web within last interval.
>
>
Each TWiki web has an automatic email alert service that sends a list of recent changes on a preset schedule, like once a day. Users can subscribe and unsubscribe using WebNotify in each web. The Perl script mailnotify is called by a background process at regular intervals. The script sends an automated email to subscribed users if topics were changed in a web since the script was last run.

TWiki handles WebNotify entries that include the WikiName of a user or a TWikiGroup and an optional e-mail address. Example entries in WebNotify:

    * Main.FredBloggs
    * Main.FredBloggs - secondary@home.com
    * Main.EngineeringGroup

The first entry is the default form, the notification gets sent to the e-mail address specified in the user's home page. The second entry lists an alternative e-mail address. The third entry specifies a group, the notification gets sent to each member of the group.

You can also use %MAINWEB% instead of Main, but this is not necessary even if you have renamed the main web by configuring $mainWebname in TWiki.cfg.


Deleted:
<
<

Configuring Outgoing Mail

TWiki.Tukro will use the Net::SMTP module if it is installed on your system. Set this with the SMTPMAILHOST variable in TWikiPreferences.

Added:
>
>
The notify e-mail uses the default changes.tmpl template, or a skin if activated in the TWikiPreferences.

mailnotify also relies on two hidden files in each TWiki/data/[web] directory: .changes and .mailnotify. Make sure both are writable by your web server process. .changes contains a list of changes; go ahead and make this empty. .mailnotify contains a timestamp of the last time notification was done.


You can use an external mail program, like sendmail, if the Net::SMTP module is not installed. Set the program path in $mailProgram in TWiki.cfg.

  • HELP Net::SMTP can be easily disabled (ex: if there is an installation error) by setting SMTPMAILHOST in TWikiPreferences to an empty value.
Line: 93 to 109

Added:
>
>
-- MikeMannix? - 01 Dec 2001
-- PeterThoeny - 30 Jan 2003

 <<O>>  Difference Topic TWikiSiteTools (r1.6 - 04 May 2002 - MikeMannix?)
Line: 1 to 1
Changed:
<
<
META TOPICINFO MikeMannix? date="1007450541" format="1.0" version="1.5"
>
>
META TOPICINFO MikeMannix? date="1020528636" format="1.0" version="1.6"

TWikiSiteTools

Utilities for searching, navigation, and monitoring site activity

Deleted:
<
<

Overview


TWikiSiteTools include utilities for navigating, searching and keeping up with site activity. Preferences can be configured by web or site-wide. You are currently in the TWiki web. In particular, TWiki provides two highly configurable, automated site monitoring tools, WebNotify, to email alerts when topics are edited, and WebStats, to generate detailed activity reports.

WebNotify Recent Changes Alert


 <<O>>  Difference Topic TWikiSiteTools (r1.5 - 04 Dec 2001 - MikeMannix?)
Line: 1 to 1
Changed:
<
<
META TOPICINFO MikeMannix? date="1007288520" format="1.0" version="1.4"
>
>
META TOPICINFO MikeMannix? date="1007450541" format="1.0" version="1.5"

TWikiSiteTools

Line: 17 to 17

Configuring Outgoing Mail

Changed:
<
<
TWiki.Tukro will use the Net::SMTP module in case it is installed on your system. You need to specify the SMTPMAILHOST variable in TWikiPreferences.
>
>
TWiki.Tukro will use the Net::SMTP module if it is installed on your system. Set this with the SMTPMAILHOST variable in TWikiPreferences.

Changed:
<
<
You can use an external mail program like sendmail in case the Net::SMTP module is not installed. In this case specify the $mailProgram in twiki/bin/TWiki.cfg.
>
>
You can use an external mail program, like sendmail, if the Net::SMTP module is not installed. Set the program path in $mailProgram in TWiki.cfg.

  • HELP Net::SMTP can be easily disabled (ex: if there is an installation error) by setting SMTPMAILHOST in TWikiPreferences to an empty value.

  • TIP You can set a separate SMTPSENDERHOST variable to define the mail sender host (some SMTP installations require this).

Setting the Automatic Email Schedule


 <<O>>  Difference Topic TWikiSiteTools (r1.4 - 02 Dec 2001 - MikeMannix?)
Line: 1 to 1
Changed:
<
<
META TOPICINFO MikeMannix? date="1007201024" format="1.0" version="1.3"
>
>
META TOPICINFO MikeMannix? date="1007288520" format="1.0" version="1.4"

TWikiSiteTools

Line: 13 to 13

Each TWiki web has an automatic email alert service that sends a list of recent changes on a preset schedule, like once a day. Users can subscribe and unsubscribe using WebNotify in each web. The Perl script mailnotify is called by a deamon in regular intervals. The script sends an automated email to subscribed users if topics were changed in a web within last interval.

Added:
>
>

Configuring Outgoing Mail

TWiki.Tukro will use the Net::SMTP module in case it is installed on your system. You need to specify the SMTPMAILHOST variable in TWikiPreferences.

Line: 36 to 38

replacements (as of 2001-11-20, none of them free).
Deleted:
<
<

WebChanges

To check for the most recently edited topics while on-site, use the WebChanges link, usually located on the upper toolbar. It lists the _ most recently modified, newest first, along with the first couple of lines of the page content.


WebStatistics Site Usage Log

You can generate a listing manually, or on an automated schedule, of visits to individual pages, on a per web basis. Compiled as a running total on a monthly basis. Includes totals for Topic Views, Topic Saves, Attachment Uploads, Most Popular Topics with number of views, and Top Contributors showing total of saves and attachment uploads. Previous months are saved.

Added:
>
>

Configuring for Automatic Operation

  • You can automatically generate usage statistics for all webs. To enable this:
Line: 71 to 71

See also: TWikiVariables for including hard-coded searches in text.

Added:
>
>

WebChanges

To check for the most recently edited topics while on-site, use the WebChanges link, usually located on the upper toolbar. It lists the most recently modified topics, newest first, along with the first couple of lines of the page content.

This is simply a preset SEARCH. The number of topics listed by the limit parameter.:

%SEARCH{".*" web="TWiki" regex="on" nosearch="on" order="modified" 
reverse="on" limit="50"}%

WebIndex

WebIndex lists all web topics in alphabetical order, with the first couple of lines of text. This is simply a preset SEARCH:

%SEARCH{"\.*" scope="topic" regex="on" nosearch="on"}%

-- MikeMannix? - 01 Dec 2001


 <<O>>  Difference Topic TWikiSiteTools (r1.3 - 01 Dec 2001 - MikeMannix?)
Line: 1 to 1
Changed:
<
<
META TOPICINFO MikeMannix? date="1007113980" format="1.0" version="1.2"
>
>
META TOPICINFO MikeMannix? date="1007201024" format="1.0" version="1.3"

TWikiSiteTools

Line: 11 to 11

WebNotify Recent Changes Alert

Changed:
<
<
Each TWiki web has an automatic email alert service that sends a list of recent changes on a preset schedule, like once a day. Users can subscribe and unsubscribe using WebNotify in each web.

How It Works

The Perl script mailnotify is called by a deamon in regular intervals. The script sends an automated email to subscribed users if topics were changed in a web within last interval.

>
>
Each TWiki web has an automatic email alert service that sends a list of recent changes on a preset schedule, like once a day. Users can subscribe and unsubscribe using WebNotify in each web. The Perl script mailnotify is called by a deamon in regular intervals. The script sends an automated email to subscribed users if topics were changed in a web within last interval.

Configuring Outgoing Mail


 <<O>>  Difference Topic TWikiSiteTools (r1.2 - 30 Nov 2001 - MikeMannix?)
Line: 1 to 1
Changed:
<
<
META TOPICINFO MikeMannix? date="1006515285" format="1.0" version="1.1"
>
>
META TOPICINFO MikeMannix? date="1007113980" format="1.0" version="1.2"

TWikiSiteTools

Line: 7 to 7

Overview

Changed:
<
<
TWikiSiteTools include utilities for navigating, searching and keeping up with site activity. Preferences can be configured by web or site-wide. You are currently in the TWiki web.
>
>
TWikiSiteTools include utilities for navigating, searching and keeping up with site activity. Preferences can be configured by web or site-wide. You are currently in the TWiki web. In particular, TWiki provides two highly configurable, automated site monitoring tools, WebNotify, to email alerts when topics are edited, and WebStats, to generate detailed activity reports.

Changed:
<
<

Monitoring Topic Changes

TWiki provides two highly configurable, automated site monitoring tools, WebNotify, to email alerts when topics are edited, and WebStats, to generate detailed activity reports.

WebNotify Recent Changes Alert

>
>

WebNotify Recent Changes Alert


Each TWiki web has an automatic email alert service that sends a list of recent changes on a preset schedule, like once a day. Users can subscribe and unsubscribe using WebNotify in each web.

Changed:
<
<

Setting Up WebNotify

>
>

How It Works


The Perl script mailnotify is called by a deamon in regular intervals. The script sends an automated email to subscribed users if topics were changed in a web within last interval.

Changed:
<
<
Configuring Outgoing Mail
>
>

Configuring Outgoing Mail


TWiki.Tukro will use the Net::SMTP module in case it is installed on your system. You need to specify the SMTPMAILHOST variable in TWikiPreferences.

You can use an external mail program like sendmail in case the Net::SMTP module is not installed. In this case specify the $mailProgram in twiki/bin/TWiki.cfg.

Changed:
<
<
Setting the Automatic Email Schedule
>
>

Setting the Automatic Email Schedule


For Unix platforms: Edit the cron table so that mailnotify is called in an interval of your choice. Please consult man crontab of how to modify the table that schedules program execution at certain intervals. Example:



Line: 44 to 40

replacements (as of 2001-11-20, none of them free).
Changed:
<
<

WebChanges

>
>

WebChanges


To check for the most recently edited topics while on-site, use the WebChanges link, usually located on the upper toolbar. It lists the _ most recently modified, newest first, along with the first couple of lines of the page content.

Changed:
<
<

How does it work?

WebStatistics Site Usage Log

>
>

WebStatistics Site Usage Log


You can generate a listing manually, or on an automated schedule, of visits to individual pages, on a per web basis. Compiled as a running total on a monthly basis. Includes totals for Topic Views, Topic Saves, Attachment Uploads, Most Popular Topics with number of views, and Top Contributors showing total of saves and attachment uploads. Previous months are saved.

Line: 72 to 66

WebSearch

Changed:
<
<
An extremely fast and flexible search facility.

See also: TWikiVariables


Docs Comments for this page

  • What about WebChanges: why isn't that covered here?
>
>
WebSearch is an extremely fast and flexible search facility, part of the core TWiki feature set. Options include:
  • topic title or full-text search
  • regular expressions
  • search within web or site-wide
  • index-style A-Z alphabetical listing sorted topic title
  • many more

Changed:
<
<
  • Need more details on WebNotify: How does it work? Exactly what data is emailed, in what format?
>
>
See also: TWikiVariables for including hard-coded searches in text.

Added:
>
>
-- MikeMannix? - 30 Nov 2001

 <<O>>  Difference Topic TWikiSiteTools (r1.1 - 23 Nov 2001 - MikeMannix?)
Line: 1 to 1
Added:
>
>
META TOPICINFO MikeMannix? date="1006515285" format="1.0" version="1.1"

TWikiSiteTools

Utilities for searching, navigation, and monitoring site activity

Overview

TWikiSiteTools include utilities for navigating, searching and keeping up with site activity. Preferences can be configured by web or site-wide. You are currently in the TWiki web.

Monitoring Topic Changes

TWiki provides two highly configurable, automated site monitoring tools, WebNotify, to email alerts when topics are edited, and WebStats, to generate detailed activity reports.

WebNotify Recent Changes Alert

Each TWiki web has an automatic email alert service that sends a list of recent changes on a preset schedule, like once a day. Users can subscribe and unsubscribe using WebNotify in each web.

Setting Up WebNotify

The Perl script mailnotify is called by a deamon in regular intervals. The script sends an automated email to subscribed users if topics were changed in a web within last interval.

Configuring Outgoing Mail

TWiki.Tukro will use the Net::SMTP module in case it is installed on your system. You need to specify the SMTPMAILHOST variable in TWikiPreferences.

You can use an external mail program like sendmail in case the Net::SMTP module is not installed. In this case specify the $mailProgram in twiki/bin/TWiki.cfg.

Setting the Automatic Email Schedule

For Unix platforms: Edit the cron table so that mailnotify is called in an interval of your choice. Please consult man crontab of how to modify the table that schedules program execution at certain intervals. Example:

% crontab -e
15,45 * * * * (cd ~twiki/public_html/bin; ./mailnotify -q)
The above line will call mailnotify at 15 minutes and 45 minutes past every hour. The -q switch suppresses all normal output.

For ISP installations: Many ISPs don't allow hosted accounts direct cron access, as it's often used for things that can heavily load the server. Workaround scripts are available.

On Windows NT/2000: You can use a scheduled task if you have administrative privileges. Note: AT on an NT machine is pretty limited. Microsoft lists several third-party replacements (as of 2001-11-20, none of them free).

WebChanges

To check for the most recently edited topics while on-site, use the WebChanges link, usually located on the upper toolbar. It lists the _ most recently modified, newest first, along with the first couple of lines of the page content.

How does it work?

WebStatistics Site Usage Log

You can generate a listing manually, or on an automated schedule, of visits to individual pages, on a per web basis. Compiled as a running total on a monthly basis. Includes totals for Topic Views, Topic Saves, Attachment Uploads, Most Popular Topics with number of views, and Top Contributors showing total of saves and attachment uploads. Previous months are saved.

Configuring for Automatic Operation

  • You can automatically generate usage statistics for all webs. To enable this:
    • Make sure variable $doLogTopicView, $doLogTopicSave and $doLogTopicUpload in TWiki.cfg are set. This will generate log entries in file twiki/data/log<date>.txt .
    • The WebStatistics topic must be present in all webs where you want to have statistics. You can use the topic in the Main web as a template.
    • Call the twiki/bin/statistics script from a cron job, once a day is recommended. This will update the WebStatistics topics in all webs.
    • Attention: The script must run as the same user as the CGI scripts are running, which is user nobody on most systems. Example crontab entry:
      0 0 * * * (cd /path/to/TWiki/bin; ./statistics >/dev/null 2>&1)
    • There is a workaround in case you can't run the script as user nobody : Run the utility twiki/bin/geturl in your cron job and specify the URL of the twiki/bin/statistics script as a parameter. Example:
      0 0 * * * (cd /path/to/TWiki/bin; ./geturl mydomain.com /urlpath/to/TWiki/bin/statistics >/dev/null 2>&1)

Generating Statistics Manually by URL

  • The twiki/bin/statistics script can also be executed as a CGI script, just enter the URL in your browser. Examples:
    • Update current month for all webs:
      http://mydomain.com/twiki/bin/statistics
    • Update current month for Main web only:
      http://mydomain.com/twiki/bin/statistics/Main
    • Update January 2000 for Main web:
      http://mydomain.com/twiki/bin/statistics/Main?logdate=200001

WebSearch

An extremely fast and flexible search facility.

See also: TWikiVariables


Docs Comments for this page

  • What about WebChanges: why isn't that covered here?

  • Need more details on WebNotify: How does it work? Exactly what data is emailed, in what format?

-- PeterThoeny - 16 Mar 2001 -- MikeMannix? - 23 Nov 2001



Topic TWikiSiteTools . { View | Diffs | r1.8 | > | r1.7 | > | r1.6 | More }
Revision r1.1 - 23 Nov 2001 - 11:34 - MikeMannix?
Revision r1.8 - 25 Apr 2004 - 00:10 - PeterThoeny
Copyright © 1999-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki.Tukro? Send feedback.