Calc
(→work-flow) |
(→Prerequisites) |
||
(35 intermediate revisions by one user not shown) | |||
Line 1: | Line 1: | ||
− | The Calc server is used for remote computing. Local user accounts are provided therefore. '''calc.isor.univie.ac.at''' can be accessed in 2 ways | + | The Calc server is used for remote computing. Local user accounts are provided therefore. '''calc.isor.univie.ac.at''' can be accessed in 2 ways. |
− | == | + | =Functional Range= |
− | + | Use remote computing @calc for medium large operations. For small Operations use your laptop, for large ones Ivana's cluster. | |
+ | Coordinate with your colleagues, and use gkrellm to monitor system resources. (30% virtualisation-overhead might be indicated) | ||
+ | =Backup= | ||
+ | Your data is your responsibility, since this server is '''not''' part of a BACKUP routine. Transfer your data (e.g. code and time-series) back onto your laptop or onto your share of our ''Institutsserver''.) | ||
− | Prerequisites: | + | =Access= |
+ | ==via Direct Access== | ||
+ | ===Prerequisites=== | ||
+ | # [https://zid.univie.ac.at/en/services/services-from-a-z/v/vpn-virtual-private-network/ VPN] client (no need within VLAN-168) | ||
# ssh client | # ssh client | ||
− | # X | + | # X client |
an X server is needed if graphics shall be displayed, staying in text mode you would not need it. | an X server is needed if graphics shall be displayed, staying in text mode you would not need it. | ||
+ | |||
=== work-flow === | === work-flow === | ||
Your console (terminal) still controls the session, so if e.g. your laptop runs short on batteries, your calculation is interrupted and lost. | Your console (terminal) still controls the session, so if e.g. your laptop runs short on batteries, your calculation is interrupted and lost. | ||
* login at the remote host calc.isor.univie.ac.at | * login at the remote host calc.isor.univie.ac.at | ||
ssh -X <remote_user>@calc.isor.univie.ac.at | ssh -X <remote_user>@calc.isor.univie.ac.at | ||
+ | the first time you might want to check the host-keys: | ||
+ | a6:b2:e6:b2:69:79:03:2d:dc:a8:32:f3:9d:36:b1:e3 (ECDSA) | ||
+ | 31:9a:05:c8:02:83:58:da:4e:3a:92:36:8c:89:29:c4 (RSA) | ||
* make your data available | * make your data available | ||
− | ** either by running a script to | + | ** either by running a script to connect your vladimir-data |
− | + | (only if you have got an account at the ''institutsserver'', i.e. being staff) | |
+ | mount_vladimir <vladimir_user> | ||
:* or some secure-copy transfers | :* or some secure-copy transfers | ||
scp -r <my_local_data> <remote_user>@calc.isor.univie.ac.at | scp -r <my_local_data> <remote_user>@calc.isor.univie.ac.at | ||
Line 21: | Line 32: | ||
*transfer your outcome and delete your original data (if you don't use it any more) | *transfer your outcome and delete your original data (if you don't use it any more) | ||
− | or disconnect from | + | or disconnect from vladimir |
− | + | umount_vladimir | |
− | == Virtual Desktop== | + | == via Virtual Desktop== |
[[File:VirtualDesktop.gif|right|frameless|100px|caption]] | [[File:VirtualDesktop.gif|right|frameless|100px|caption]] | ||
− | you can use a virtual desktop to login | + | you can use a virtual desktop to login the calc server. |
+ | #'''F5''' for connecting to the UNI-VPN | ||
+ | #'''vncviewer''' to connect to your Desktop | ||
+ | == via sftp and WEB-R== | ||
+ | # '''F5''' for connecting to the UNI-VPN | ||
+ | # '''sftp''' (e.g. FileZilla) to upload your workspace | ||
+ | # '''http://calc.vdc.ac:8787''' to do your '''R''' | ||
− | Prerequisites: | + | ===Prerequisites=== |
− | * vnc-client | + | * [https://zid.univie.ac.at/en/services/services-from-a-z/v/vpn-virtual-private-network/ VPN] client (can be omitted within VLAN-168) |
+ | * vnc-client like tigervnc (former tight-vnc) | ||
yum install tigervnc ''or'' apt-get install tigervnc-viewer | yum install tigervnc ''or'' apt-get install tigervnc-viewer | ||
or similar viewers for windows, etc. | or similar viewers for windows, etc. | ||
or | or | ||
− | * web-browser | + | * java enabled web-browser to run an unsigned applet (which normally causes troubles) |
− | ===work-flow=== | + | |
− | connecting through a virtual | + | ===work-flow=== |
− | + | # Establish a [https://zid.univie.ac.at/en/services/services-from-a-z/v/vpn-virtual-private-network/ VPN tunnel] to begin with. | |
− | vncviewer 131.130.97.100: | + | #: Make sure to be within the VPN university subnet. |
+ | # start your vnc-client | ||
+ | (Technically, connecting through a virtual desktop another username/password pair would be necessary.) Your username is mapped to the port:=5900+<Display> number, your password is just the same anyway.) | ||
+ | vncviewer 131.130.97.100:port | ||
or - even better tunnel the session through ssh | or - even better tunnel the session through ssh | ||
− | vncviewer -via <remote-user>@calc.isor.univie.ac.at localhost:< | + | vncviewer -via <remote-user>@calc.isor.univie.ac.at localhost:port |
− | + | Best to use the Full-Screen-Mode, note the keys how to escape, e.g. '''<Strg> + <Alt> + <Shift> + <F>''' | |
+ | Don't forget to close the vncviewer before opening it at another host to get the geometry-settings right. Some viewers like '''viagre''' disable sending special keys by default ('''<Strg>+<Q>''' in this case). Make sure to enable them, just not to get locked out in FullScreen mode. | ||
+ | |||
+ | If you use a java-enabled web-browser and allow an unsigned applet to run, calculate your Port := 5800+<Display> | ||
http://calc.isor.univie.ac.at:Port | http://calc.isor.univie.ac.at:Port | ||
− | Use your Virtual Linux Desktop's terminal (e.g. gnome-terminal) and continue as described in 1). Start your calculation and close the viewer | + | Use your Virtual Linux Desktop's terminal (e.g. gnome-terminal) and continue as described in 1). Start your calculation and close the viewer. Within the VPN uni-subnet or VLAN-168 you can re-open a viewer and continue. |
+ | ===Bugs=== | ||
+ | Avoid switching to full-screen, because vnc might get into troubles. | ||
+ | |||
+ | ==Applications== | ||
+ | ===Matlab=== | ||
+ | Open a terminal via e.g. '''Application > Favorites > Terminal'''. At the command-prompt put in '''matlab'''. After the licensing server is asked for authorization the GUI starts up. Don't close this terminal, since it's the controlling terminal for Matlab. Alternatively press '''<Alt>+<F2>''' and fill in matlab. You can also use matlab in text mode from the command line. | ||
+ | ===R studio === | ||
+ | edit R source files in some text-editor and run it afterwards, or use ''rstudio''. | ||
+ | you might also want to secure-copy files in your server share and run R-studio in a web browser: http://calc.vdc.ac:8787 | ||
+ | |||
+ | ===Python=== | ||
+ | some python-libs for finance have been installed on request. |
Latest revision as of 13:34, 5 December 2019
The Calc server is used for remote computing. Local user accounts are provided therefore. calc.isor.univie.ac.at can be accessed in 2 ways.
Contents |
[edit] 1 Functional Range
Use remote computing @calc for medium large operations. For small Operations use your laptop, for large ones Ivana's cluster. Coordinate with your colleagues, and use gkrellm to monitor system resources. (30% virtualisation-overhead might be indicated)
[edit] 2 Backup
Your data is your responsibility, since this server is not part of a BACKUP routine. Transfer your data (e.g. code and time-series) back onto your laptop or onto your share of our Institutsserver.)
[edit] 3 Access
[edit] 3.1 via Direct Access
[edit] 3.1.1 Prerequisites
- VPN client (no need within VLAN-168)
- ssh client
- X client
an X server is needed if graphics shall be displayed, staying in text mode you would not need it.
[edit] 3.1.2 work-flow
Your console (terminal) still controls the session, so if e.g. your laptop runs short on batteries, your calculation is interrupted and lost.
- login at the remote host calc.isor.univie.ac.at
ssh -X <remote_user>@calc.isor.univie.ac.at
the first time you might want to check the host-keys:
a6:b2:e6:b2:69:79:03:2d:dc:a8:32:f3:9d:36:b1:e3 (ECDSA) 31:9a:05:c8:02:83:58:da:4e:3a:92:36:8c:89:29:c4 (RSA)
- make your data available
- either by running a script to connect your vladimir-data
(only if you have got an account at the institutsserver, i.e. being staff)
mount_vladimir <vladimir_user>
- or some secure-copy transfers
scp -r <my_local_data> <remote_user>@calc.isor.univie.ac.at
- start your calculations, e.g
matlab
- transfer your outcome and delete your original data (if you don't use it any more)
or disconnect from vladimir
umount_vladimir
[edit] 3.2 via Virtual Desktop
you can use a virtual desktop to login the calc server.
- F5 for connecting to the UNI-VPN
- vncviewer to connect to your Desktop
[edit] 3.3 via sftp and WEB-R
- F5 for connecting to the UNI-VPN
- sftp (e.g. FileZilla) to upload your workspace
- http://calc.vdc.ac:8787 to do your R
[edit] 3.3.1 Prerequisites
- VPN client (can be omitted within VLAN-168)
- vnc-client like tigervnc (former tight-vnc)
yum install tigervnc or apt-get install tigervnc-viewer or similar viewers for windows, etc.
or
- java enabled web-browser to run an unsigned applet (which normally causes troubles)
[edit] 3.3.2 work-flow
- Establish a VPN tunnel to begin with.
- Make sure to be within the VPN university subnet.
- start your vnc-client
(Technically, connecting through a virtual desktop another username/password pair would be necessary.) Your username is mapped to the port:=5900+<Display> number, your password is just the same anyway.)
vncviewer 131.130.97.100:port
or - even better tunnel the session through ssh
vncviewer -via <remote-user>@calc.isor.univie.ac.at localhost:port
Best to use the Full-Screen-Mode, note the keys how to escape, e.g. <Strg> + <Alt> + <Shift> + <F> Don't forget to close the vncviewer before opening it at another host to get the geometry-settings right. Some viewers like viagre disable sending special keys by default (<Strg>+<Q> in this case). Make sure to enable them, just not to get locked out in FullScreen mode.
If you use a java-enabled web-browser and allow an unsigned applet to run, calculate your Port := 5800+<Display>
http://calc.isor.univie.ac.at:Port
Use your Virtual Linux Desktop's terminal (e.g. gnome-terminal) and continue as described in 1). Start your calculation and close the viewer. Within the VPN uni-subnet or VLAN-168 you can re-open a viewer and continue.
[edit] 3.3.3 Bugs
Avoid switching to full-screen, because vnc might get into troubles.
[edit] 3.4 Applications
[edit] 3.4.1 Matlab
Open a terminal via e.g. Application > Favorites > Terminal. At the command-prompt put in matlab. After the licensing server is asked for authorization the GUI starts up. Don't close this terminal, since it's the controlling terminal for Matlab. Alternatively press <Alt>+<F2> and fill in matlab. You can also use matlab in text mode from the command line.
[edit] 3.4.2 R studio
edit R source files in some text-editor and run it afterwards, or use rstudio. you might also want to secure-copy files in your server share and run R-studio in a web browser: http://calc.vdc.ac:8787
[edit] 3.4.3 Python
some python-libs for finance have been installed on request.