Task Spooler (tsp<\/strong>) is not installed on every Linux server. However, we mention it here because if it happens to be available, it is a straightforward way to run many jobs.<\/p>\n Task Spooler is a type of job queuing software. There are many more complicated job queueing software packages. Task Spooler is a particularly simple tool. It only runs on one server for one user.<\/p>\n The tsp<\/strong> command will run a job in the background; this lets you run other commands while tsp<\/strong> is busy running your program. The tsp<\/strong> command will even keep running your jobs after you logout or disconnect from the server.<\/p>\n In its normal setup, only one job will run with tsp<\/strong> at a time.\u00a0 Once the first job finishes, tsp<\/strong> will automatically start the next job. This list of waiting jobs is called queuing<\/em>, and is analogous to the lineup at a grocery store.<\/p>\n Let’s start taking a more concrete look at how to use the tsp command.<\/p>\n Just put tsp<\/strong> in front of the command you want to run. Note that tsp<\/strong> can only directly run a single command, but itself does not handle the special functionality of the Unix shell. So for example if you use a command containing pipes or output redirects, then it is easiest to put those shell commands into a file. This file is called a shell script, but is out of the scope of our current discussion.<\/p>\n Let’s run a fictitious program called `run_simulation` using tsp<\/strong>:<\/p>\n We have queued up 3 jobs, each running a run_simulation<\/strong>. We’ll move on now to ways of managing jobs and getting output.<\/p>\n You can view your list of tsp jobs:<\/p>\n The number from the ID column will be used to refer to particular jobs. The State column tells you the progress tsp is making in your job queue.<\/p>\n One important caveat – the list of jobs is kept in memory.\u00a0 So if your server reboots then you will lose any existing jobs.\u00a0 So it is important to collect any needed information about completed jobs.<\/p>\n Let’s assume you have some finished tsp<\/strong> jobs that look like this:<\/p>\n Note that tsp gives each job an ID. \u00a0You can see the output of job with ID 1:<\/p>\n tsp -c 1<\/strong> And to see detailed information about the job:<\/p>\n To remove a queued job with ID 2:<\/p>\n To clear the list of all finished jobs:<\/p>\n To kill (stop) a running job with ID 2:<\/p>\n The tsp command can run more than one job at the same time.\u00a0 In the\u00a0tsp<\/strong> queue list, the header indicates how many jobs are running, and how many are allowed to run.<\/p>\n However, if your job already uses multiple cores or if your job uses most of the server’s RAM, then you should not run multiple tsp jobs at the same time.<\/p>\n For example, to run 4 jobs at the same time:<\/p>\n Overview Task Spooler (tsp) is not installed on every Linux server. However, we mention it here because if it happens to be available, it is a straightforward way to run many jobs. Task Spooler is a type of job queuing software. There are many more complicated job queueing software packages. Task Spooler is a particularly […]<\/p>\n","protected":false},"author":6,"featured_media":0,"parent":96,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","_mi_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":"","_links_to":"","_links_to_target":""},"yoast_head":"\nRunning Jobs<\/h2>\n
\n
tsp .\/run_simulation -t 10\r\ntsp .\/run_simulation -t 3\r\ntsp .\/run_simulation -t 20\r\ntsp<\/strong>\r\nID State Output E-Level Times(r\/u\/s) Command [run=1\/1]\r\n0 running \/tmp\/ts-out.Smoz2i .\/run_simulation -t 10\r\n1 queued (file) .\/run_simulation -t 3\r\n2 queued (file) .\/run_simulation -t 20<\/pre>\n<\/blockquote>\n
Listing Jobs<\/h2>\n
\n
tsp<\/strong>\r\nID State Output E-Level Times(r\/u\/s) Command [run=1\/1]\r\n1 running \/tmp\/ts-out.IiCgZe .\/run_simulation -t 10\r\n2 queued (file) .\/run_simulation -t 10\r\n0 finished \/tmp\/ts-out.QUFZ40 0 2.00\/0.00\/0.00 .\/run_simulation -t 2<\/pre>\n<\/blockquote>\n
Inspecting Jobs<\/h2>\n
\n
tsp<\/strong>\r\nID State Output E-Level Times(r\/u\/s) Command [run=1\/1]\r\n0 finished \/tmp\/ts-out.Smoz2i 0 10.04\/0.00\/0.00 .\/run_simulation -t 10\r\n1 finished \/tmp\/ts-out.1UDMiN 0 3.02\/0.00\/0.00 .\/run_simulation -t 3\r\n2 finished \/tmp\/ts-out.twnIHU 0 20.11\/0.00\/0.00 .\/run_simulation -t 20<\/pre>\n<\/blockquote>\n
\nThis is sample output from
\na program!<\/p><\/blockquote>\n\n
tsp -i 1<\/strong>\r\nExit status: died with exit code 0\r\nCommand: .\/run_simulation -t 3\r\nSlots required: 1\r\nEnqueue time: Fri Jul 14 10:45:28 2017\r\nStart time: Fri Jul 14 10:45:38 2017\r\nEnd time: Fri Jul 14 10:45:41 2017\r\nTime run: 3.021296s<\/pre>\n<\/blockquote>\n
Cleaning up Jobs<\/h2>\n
\n
tsp -r 2<\/strong><\/pre>\n<\/blockquote>\n
\n
tsp -C<\/strong><\/pre>\n<\/blockquote>\n
\n
tsp -k 2<\/strong><\/pre>\n<\/blockquote>\n
Concurrent Jobs<\/h2>\n
\n
tsp<\/strong>\r\nID State Output E-Level Times(r\/u\/s) Command [run=0\/1<\/strong>]\r\n\r\ntsp -S 4<\/strong>\r\n\r\ntsp<\/strong>\r\nID State Output E-Level Times(r\/u\/s) Command [run=0\/4<\/strong>]<\/pre>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"