AFD Control

To control and monitor the AFD there is an X11 interface, with the following appearance:

As shown this dialog is divided into four main areas: menu, heading, connection and status.

Menu

The menu area has five pull down buttons: Host, View, Control and Setup. If your afd_ctrl window does not have all buttons shown and described here, then the system administrator did not allow you to use this function, see afd.users for more details.

Handle event	This allows one to acknowledge an error situation, put an error situation offline or unset the acknowledge and/or offline setting. You must select one or more host to get the handle_event popup. In the reason text field one can enter a reason which will then show up in the event log via the show_elog dialog. Acknowledging an event means that the destination alias field now becomes pink (). If the host is put offline it will turn Steelblue () and errors and warnings will be marked as offline in the logs. If one knows in advance the time when a host is offline, you can do so by enabling 'Time frame' and entering time values at 'Start time' and 'End time'. The format can be one of the following: MMDDhhmm, DDhhmm or hhmm.
Start/Stop input queue	Allows you to start or stop the queue of one or more selected hosts. When the queue is stopped the queue led turns brown. Stopping the queue means that AFD internally will not generate any messages, but no data is lost either. All current jobs that have a message will still be transmitted.
Start/Stop transfer	Allows you to start or stop the transfer of one or more selected hosts. When the transfer is stopped the transfer led will be orange. Stopping the transfer means that messages are still being generated, but the FD will not distribute the files. Care should be taken when choosing this option. Watch the job queue number so it does not reach a critical stage. Use Start/Stop queue if lots of files are being distributed for this host.
Start/Stop host	Allows you to start or stop a host. Stopping a host means stopping transfer and queue, but no data will be lost. If the data is not required, press Enable/Disable host below. In case the queue or transfer is already stopped and you then press this button it will respectively close the transfer or queue. When the queue is stopped the queue led turns brown and the transfer led will be orange.
Enable/Disable host	When you want to stop a host and do not want to collect the data for it, disable it by pressing this button. NOTE: All current jobs for this host will be deleted when disabling a host.
Switch host	Switch host allows to change the destination address of selected host. To see whether a certain host has a secondary address look in afd_info dialog.
Retry	Retry can only be used when there are jobs queued by FD for this host and you would like AFD to immediately try and send the files. This is useful in error situation when the error condition has been fixed and you do not want to wait for the next scheduled retry by AFD.
Debug	Debug This enables or disables normal debugging for the given host. With this enables you can see step by step what is being done. To watch the output the Transfer Debug Log button. The contents of the debug log is described in Log Files. Trace With this you enable a lot more debug output, each command send and its reply from the remote partner is shown. This can be quit CPU intensive and the log files grow very quickly, so don't leave this on for to long. This is the reason why this only works with the extra process sf_xxx_trace. Full Trace This is the same as Trace only with this set you will be able to see the contents of the file that is being transmitted. This will be more CPU intensive if the files being transmitted are large.
Simulate mode	The transfer for the selected host will be simulated. No data is send or retrieved. All data and commands are sent to /dev/null, so data is lost if this is enabled.
Search + (De)Select	This allows to search for a given host (alias and real) name, with wild cards, when selecting search type Hostname. If instead Information is selected as search type, it will search the host information file(s) for the given information. The found hosts will then be selected.
Long/Short line	The selected lines will be converted to long or short lines. In short line mode only the host alias name will be displayed at the bottom of the afd_ctrl dialog window.
Test	Test the connection to the selected host. Two tests are possible, ping and traceroute. To make these visible you must configure PING_CMD and/or TRACEROUTE_CMD in AFD_CONFIG file.
Load	Load shows the current load of either: Files send per second, KBytes send per second, Connections done per second and the number of Active-Transfers.
Exit	Exit will close the afd_ctrl window and all other windows that have been started from this dialog. It does not effect any of the main process of the AFD running in the background.

Font size	Pressing Font size will give you a list of fonts which, when selected, will be used for the afd_ctrl window and all other windows called from it. It might be that your X server does not support all fonts shown on the right hand, then you will be shown less fonts.
Number of rows	Number of rows allows to change the maximum number of rows to be displayed for one column.
Line Style	Line Style allows to change the appearance of a single line. You can currently choose four different items: Leds, Process, Characters and Bars. Default will be that all four items will be visible. If you do have a very large number of hosts you can deselect some items to reduce the window size of the afd_ctrl dialog.
	Process can be viewed in Normal mode, that looks as follows: or in Compact mode . Or one can leave the process completely away (None).
Other options	Other options just has one option 'Force shift select'. Normally one can select a line by just pressing that line with the left mouse button. This can however lead to accidantly pressing a line and one can force the user to use the shift button together with the left mouse button to select a line.
Save Setup	Save Setup will save the above settings in the file .afd_ctrl.setup.@. in the users home directory. So when you start afd_ctrl again it will start with these settings.

Heading

The heading is just a quick reminder of what the fields in the connection area mean:

Connection

The connection area is the actual area which monitors and controls the AFD. The meaning of each field is shown below:

1	Destination alias	This field holds the name of the destination alias. The background color indicates the current status of the connection: No transfer. Waiting for files to come. Transfer active. Files are currently being transferred. Errors acknowledged. Files cannot be transmitted. Errors/Warnings offline. Files cannot be transmitted. Error and warnings have been put offline. Error. Files cannot be transmitted. It turns red when the error counter has reached the value set in the HOST_CONFIG file. There is no entry of this host in the DIR_CONFIG. This host is disabled. All files in the input directories for this host will be deleted.
2	Debug Led	If this is yellow debug is on for this destination. Do not let debug on for very long on high traffic connections. Since this means lots of data gets written to the log file. See Log Files for more information of the debug output.
3	Queue Led	The color of this LED tells what the AMG will do when files arrive for this destination. Normal status. Messages will be generated for the FD. There are jobs in the error queue. Further jobs, which are in the error queue, will be held back once a certain number have been queued. Queue stopped by user. Files for this host are saved in a a separate directory and no messages are generated. Queue stopped automatically. Files for this host are saved in a a separate directory and no messages are generated.
4	Transfer Led	This LED is split in two half's. The top half is for output and the bottom part is input. The color tells the status of this which can be one of the following: Normal status, retrieve not configured. Files will be distributed by the FD. Normal status, retrieve disabled. Files will be distributed by the FD. Normal status, distribution not configured. Files will be retrieved by the FD. Normal status. Files will be retrieved and distributed by the FD. Distribution stopped, retrieve not configured. No files will be distributed. Distribution stopped, retrieve disabled. No files will be distributed. Retrieve stopped, distribution not configured. No files will be retrieved. Transfer stopped by user. No files will be distributed. No distribution configured, retrieve disabled. No retrieve or distribution configured. No retrieve or distribution will be done. Distribution of files will just be simulated. Data will be written to /dev/null. No retrieve or distribution will be done. Fetching of files will just be simulated. Data will be written to /dev/null. No retrieve or distribution will be done. Distribution and fetching of files will just be simulated. Data will be written to /dev/null.
5	Detailed Selection	Shows all details for this job.
6	Connection	This field shows the number of files currently being transferred for this host. The background color indicates the current status of the process. Normal status. No transfer is active for this process. FTP Connecting Phase. This includes making the connection to the remote FTP-server, setting transfer mode and sending user name and password. FTP Transfer active. There are still two files to be transferred. FTP Bursting. During an active transmission two more files have arrived, these have been appended to the current transfer job. SCP Transfer active. There are still two files to be transferred. SFTP Transfer active. There are still two files to be transferred. SFTP Bursting. During an active transmission two more files have arrived, these have been appended to the current transfer job. SFTP fetch active. There are still two files to be fetched. Closing Phase. This includes removing any lock files and closing the connection to the remote server. This is valid only for FTP, SFTP and HTTP. Local transfer active. There are still two files to be copied. Local Bursting. During an active transmission two more files have arrived, these have been appended to the current transfer job. Mail transfer active. There are still two files to be mailed. Mail Bursting. During an active transmission two more files have arrived, these have been appended to the current transfer job. WMO transfer active. There are still two files to be send via TCP/IP socket. WMO burst transfer active. During an active transmission two more files have arrived, these have been appended to the current transfer job. Execution phase after the file was distributed. This phase is only reached when the pexec options is used. Error. An error has occurred while trying to distribute files.
7	File Counter	Total number of files that still have to be send for this destination. The numbers will be shown up to 9999 files, after this a character will be added: m for Mega Files (1000 * 1000 files), g for Giga Files (1000 * 1000 * 1000 files), t for Tera Files (1000 * 1000 * 1000 * 1000 files), p for Peta Files (1000 * 1000 * 1000 * 1000 * 1000 files) and e for Exa Files (1000 * 1000 * 1000 * 1000 * 1000 * 1000 files).
8	File Size	Total number of bytes that still have to be send for this destination. The last character always shows the current unit: B for Bytes, K for Kilo Bytes (1024 Bytes), M for Mega Bytes (1024 * 1024 Bytes), G for Giga Bytes (1024 * 1024 * 1024 Bytes), T for Tera Bytes (1024 * 1024 * 1024 * 1024 Bytes), P for Peta Bytes (1024 * 1024 * 1024 * 1024 * 1024 Bytes) and E for Exa Bytes (1024 * 1024 * 1024 * 1024 * 1024 * 1024 Bytes).
9	Transfer Rate	Displays the total current transfer rate of all connections to this destination.
10	Error Counter	Number of errors that occurred for this destination. This will always be reset to zero when a file has been distributed successfully. If the number of errors is larger then two digits a greater sign (>) will be displayed.
11	Error Counter Bar	Displays a bar for the number of errors for this destination. The color of the bar will be green when the error counter is low and will increasingly turn red the larger the error counter becomes.
12	Transfer Rate Bar	Displays a yellow bar to display the transfer rate to this destination graphically.

Selecting can be done by either holding down the shift key and pressing the left mouse button (temporary selection) or by holding the ctrl key and the left mouse button (permanent selection). The background of the line will change to black or grey respectively.

Pressing the right mouse button in the connection field will open the following popup and the following actions can be chosen from for selected lines:

Handle event	This allows one to acknowledge an error situation, put an error situation offline or unset the acknowledge and/or offline setting. You must select one or more host to get the handle_event popup. In the reason text field one can enter a reason which will then show up in the event log via the show_elog dialog. Acknowledging an event means that the destination alias field now becomes pink (). If the host is put offline it will turn Steelblue () and errors and warnings will be marked as offline in the logs.
Start/Stop input queue	Allows you to start or stop the queue of one or more selected hosts. When the queue is stopped the queue led turns brown. Stopping the queue means that AFD internally will not generate any messages, but no data is lost either. All current jobs that have a message will still be transmitted.
Start/Stop transfer	Allows you to start or stop the transfer of one or more selected hosts. When the transfer is stopped the transfer led will be orange. Stopping the transfer means that messages are still being generated, but the FD will not distribute the files. Care should be taken when choosing this option. Watch the job queue number so it does not reach a critical stage. Use Start/Stop queue if lots of files are being distributed for this host.
Start/Stop host	Allows you to start or stop a host. Stopping a host means stopping transfer and queue, but no data will be lost. If the data is not required, press Enable/Disable host below. In case the queue or transfer is already stopped and you then press this button it will respectively close the transfer or queue. When the queue is stopped the queue led turns brown and the transfer led will be orange.
Enable/Disable host	When you want to stop a host and do not want to collect the data for it, disable it by pressing this button. NOTE: All current jobs for this host will be deleted when disabling a host.
Switch host	Switch host allows to change the destination address of selected host. To see whether a certain host has a secondary address look in afd_info dialog.
Retry	Retry can only be used when there are jobs queued by FD for this host and you would like AFD to immediately try and send the files. This is useful in error situation when the error condition has been fixed and you do not want to wait for the next scheduled retry by AFD.
Debug	Debug This enables or disables normal debugging for the given host. With this enables you can see step by step what is being done. To watch the output the Transfer Debug Log button. The contents of the debug log is described in Log Files. Trace With this you enable a lot more debug output, each command send and its reply from the remote partner is shown. This can be quit CPU intensive and the log files grow very quickly, so don't leave this on for to long. This is the reason why this only works with the extra process sf_xxx_trace. Full Trace This is the same as Trace only with this set you will be able to see the contents of the file that is being transmitted. This will be more CPU intensive if the files being transmitted are large.
Info	The Info button opens the afd_info dialog for this host.
Configuration	Shows the DIR_CONFIG configuration of the selected host.

Status

1	AMG	LED to show current status of process AMG (Automatic Message Generator). Normal status. Process is up and running. Process has terminated normally. Abnormal termination. Process has been killed and is not running any more. NOTE: This LED must be so that the AFD can function properly.
2	FD	LED to show current status of process FD (File Distributor). Normal status. Process is up and running. Process has terminated normally. Abnormal termination. Process has been killed and is not running any more. NOTE: This LED must be so that the AFD can function properly.
3	Archive Watch	LED to show current status of process Archive Watch. Normal status. Process is up and running. Process has terminated normally. Abnormal termination. Process has been killed and is not running any more.
4	AFDD	LED to show current status of process AFDD. This might be missing if you did not set the AFD_TCP_PORT option in the AFD_CONFIG file. Normal status. Process is up and running. Process has terminated normally. Abnormal termination. Process has been killed and is not running any more.
5	Receive Log	Radar that shows the five last type of messages in the receive log. Color Log Symbol Description <I> Information, nothing serious. <W> Warning. Processing of data on input or warnings about old files in directory where there is no rule to distribute these. <E> Error is encountered during processing of data. <F> A fatal error has occurred, the process involved has most properly terminated abnormally.
6	System Log	Radar that shows the five last type of messages in the system log. It can have the following colors: Color Log Symbol Description <I> Information, nothing serious. <C> Configuration, something has been configured. <W> Warning. Most properly a configuration error, nothing to be nervous about. <E> Error, AFD should still be able to continue, but something is wrong! <F> A fatal error has occurred, the process involved has most properly terminated abnormally. Now you should really be nervous! <#> Dummy sign. Is used for showing a new month in the system log or when there is garbage or no information in the log file.
7	Transfer Log	Radar that shows the five last type of messages in the transfer log. Color Log Symbol Description <I> Information, nothing serious. <W> Warning. A file could for example not be renamed because it already existed. <E> Error. File could not be transmitted, see the log for more details. <F> A fatal error has occurred, the process involved has most properly terminated abnormally.
8	Transfer Log History	Depending on the width of the afd_ctrl window, this will show the last 48 hours of what has happened in the transfer log. It shows the current hour on the right hand side and will move one position to the left every hour. Each square represents one hour and the color will be always the one with the highest severity that has occurred during that hour. The order is as follows, starting with the highest severity: Fatal , Error , Warn and Info .
9	System Log History	Same as above only for the system log and that it will have more colors. The order of the colors here is as follows, again starting with the highest severity: Fatal , Error , Warn , Config , Info and Dummy (date, etc)
10	Receive Log History	See Transfer Log History above.
11	Job Queue Counter	This counter shows how many jobs are currently being queued.

Job Details

The job details can be viewed by clicking with the right mouse button and holding the Ctrl button simultaneously when the mouse cursor is on a connection field. It shows a more detailed view of what the current job is doing. If all data has been transmitted the rotating dash in the center will go away. To make a very long file name visible you can make this window longer by putting the cursor into the job details window and simultaneously press the Ctrl button and press the right mouse button. The left mouse button will make it shorter.

Copyright © 1997 - 2014 by H.Kiehl Holger.Kiehl@dwd.de Last updated: 02.12.2014

Index

Home