User Tools

Site Tools


cluster:cluster

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
cluster:cluster [2023-03-21 13:27] – [Job Submission with GNU parallel] Markus Rosenstihlcluster:cluster [2024-10-08 11:54] (current) – [AG Vogel] Markus Rosenstihl
Line 1: Line 1:
 ====== Tips/Tricks ====== ====== Tips/Tricks ======
  
-===== Profiling ====+===== Profiling C Programs ====
 You can profile programs with [[https://valgrind.org/docs/manual/cl-manual.html#cl-manual.options|''valgrind'']] and analyze the output file with ''kcachegrind''. You can profile programs with [[https://valgrind.org/docs/manual/cl-manual.html#cl-manual.options|''valgrind'']] and analyze the output file with ''kcachegrind''.
  
Line 20: Line 20:
 === Generelle Punkte === === Generelle Punkte ===
 == Gross ist besser == == Gross ist besser ==
-Lieber wenige grosse Dateien als viele kleine Dateien, grose Dateien erzeugen weniger IOPS, das bleastet das Netzwerk und die SSDs nicht so stark.+Lieber wenige grosse Dateien als viele kleine Dateien, grose Dateien erzeugen weniger IOPS, das belastet das Netzwerk und die SSDs nicht so stark.
 Nicht vergessen, es könnten noch viele andere ebenfalls auf das gleiche Dateisystem zugreifen. Nicht vergessen, es könnten noch viele andere ebenfalls auf das gleiche Dateisystem zugreifen.
  
Line 306: Line 306:
 </code> </code>
  
 +===== Tools =====
 +These are tools that exist, if requested we will try and make them available on the cluster:
 +
 +  * [[https://researchcomputing.princeton.edu/support/knowledge-base/spark|Spark]]
 +  * [[https://docs.dask.org/en/stable/deploying.html|Dask]]
 +  * [[https://modin.readthedocs.io/en/stable/|Modin]]
 +  * [[https://researchcomputing.princeton.edu/support/knowledge-base/apptainer|Apptainer]]
 ====== Group Specific ====== ====== Group Specific ======
 ===== AG Drossel ===== ===== AG Drossel =====
 ===== AG Liebchen ===== ===== AG Liebchen =====
 ===== AG Vogel ===== ===== AG Vogel =====
 +
 +The head node protein does not allow password logins, you need to use ssh keys.
 +
 +  - create a key: ''ssh-keygen -t ed25519''
 +  - We admins stronlgy recommend to use a very strong passphrase. Together with ssh-agent you have to type it only once per login to your desktop!
 +  - add the public part to the authorized_keys file and set correct premissions: ''cat .ssh/id_ed25519.pub | tee -a .ssh/authorized_keys && chmod 0600 .ssh/authorized_keys''
 +  - now login to protein.cluster, it may ask for the passphrase.
 +  
 +===== SSH Agent =====
 +
 +The ''ssh-agent'' should be startet automatically on login, Cinnamon for example will show a screen upon login to the desktop. If not you need to set the **GNOME Keyring SSH Agent** to start automatically:
 +
 +{{:cluster:startup_apps_cinnamon.png?600 |}}
 +
 +  
  
cluster/cluster.1679401664.txt.gz · Last modified: 2023-03-21 12:17 (external edit)