Background
HTCondor is a scheduler system for running batch jobs in distributing computing on large scale computing clusters or grids that enable scientists and engineers to increase their computing throughput. ( See more at What is HTCondor?)
Use of the Biochemistry cluster requires using HTCondor to schedule non-interactive jobs. As such knowledge of the bash Unix shell is essential.
Using HTcondor on the Biochemistry cluster, December 14, 2023 session
– Slides: PPTX, PDF
– handout: In class short hand out (jupyter notebook) – PDF
– quickstart
– Videos: Guide to Submitting HTCondor jobs (Posted on March 15, 2022)
– Using Docker containers on Biochemistry Linux Cluster (Posted on November 2, 2023)
– BCC hardware info
Tutorial(s)
TUTORIAL 1 – Accessing Linux cluster and HTCondor
(Last updated: Dec 30, 2022)
In class short hand out (rendered ipython jupyter notebook) – PDF
- Accessing Linux cluster and HTCondor: (HTML) htcondor_biochem_v1.5.5
- Accessing Linux cluster and HTCondor: htcondor_biochem_v1.5.0.pdf (older PDF)
REFERENCE(S):
- Douglas Thain, Todd Tannenbaum, and Miron Livny, “Distributed Computing in Practice: The Condor Experience” Concurrency and Computation: Practice and Experience, Vol. 17, No. 2-4, pages 323-356, February-April, 2005. PDF