Calc

From ISOR
(Difference between revisions)
Jump to: navigation, search
(work-flow)
(Prerequisites)
 
(21 intermediate revisions by one user not shown)
Line 3: Line 3:
 
Use remote computing @calc for medium large operations. For small Operations use your laptop, for large ones Ivana's cluster.
 
Use remote computing @calc for medium large operations. For small Operations use your laptop, for large ones Ivana's cluster.
 
Coordinate with your colleagues, and use gkrellm to monitor system resources. (30% virtualisation-overhead might be indicated)
 
Coordinate with your colleagues, and use gkrellm to monitor system resources. (30% virtualisation-overhead might be indicated)
 +
=Backup=
 +
Your data is your responsibility, since this server is '''not''' part of a BACKUP routine. Transfer your data (e.g. code and time-series) back onto your laptop or onto your share of our ''Institutsserver''.)
  
 
=Access=
 
=Access=
==Direct Access==
+
==via Direct Access==
via ssh from your client machine within VLAN-168 (with an IP: 131.130.96.Z).
+
 
+
 
===Prerequisites===
 
===Prerequisites===
 +
# [https://zid.univie.ac.at/en/services/services-from-a-z/v/vpn-virtual-private-network/ VPN] client (no need within VLAN-168)
 
# ssh client
 
# ssh client
# X server
+
# X client
  
 
an X server is needed if graphics shall be displayed, staying in text mode you would not need it.
 
an X server is needed if graphics shall be displayed, staying in text mode you would not need it.
Line 18: Line 19:
 
* login at the remote host calc.isor.univie.ac.at
 
* login at the remote host calc.isor.univie.ac.at
 
  ssh -X <remote_user>@calc.isor.univie.ac.at
 
  ssh -X <remote_user>@calc.isor.univie.ac.at
 +
the first time you might want to check the host-keys:
 +
a6:b2:e6:b2:69:79:03:2d:dc:a8:32:f3:9d:36:b1:e3  (ECDSA)
 +
31:9a:05:c8:02:83:58:da:4e:3a:92:36:8c:89:29:c4  (RSA)
 
* make your data available  
 
* make your data available  
** either by running a script to connect your lucky-data
+
** either by running a script to connect your vladimir-data
  mount_lucky <lucky_user>
+
(only if you have got an account at the ''institutsserver'', i.e. being staff)
 +
  mount_vladimir <vladimir_user>
 
:* or some secure-copy transfers
 
:* or some secure-copy transfers
 
  scp -r <my_local_data> <remote_user>@calc.isor.univie.ac.at
 
  scp -r <my_local_data> <remote_user>@calc.isor.univie.ac.at
Line 27: Line 32:
 
*transfer your outcome and delete your original data (if you don't use it any more)
 
*transfer your outcome and delete your original data (if you don't use it any more)
  
or disconnect from lucky
+
or disconnect from vladimir
  umount_lucky
+
  umount_vladimir
  
== Virtual Desktop==
+
== via Virtual Desktop==
 
[[File:VirtualDesktop.gif|right|frameless|100px|caption]]
 
[[File:VirtualDesktop.gif|right|frameless|100px|caption]]
you can use a virtual desktop to login there first, then access the calc server.
+
you can use a virtual desktop to login the calc server.
 +
#'''F5''' for connecting to the UNI-VPN
 +
#'''vncviewer''' to connect to your Desktop
 +
== via sftp and WEB-R==
 +
# '''F5''' for connecting to the UNI-VPN
 +
# '''sftp''' (e.g. FileZilla) to upload your workspace
 +
# '''http://calc.vdc.ac:8787''' to do your '''R'''
  
 
===Prerequisites===
 
===Prerequisites===
 +
* [https://zid.univie.ac.at/en/services/services-from-a-z/v/vpn-virtual-private-network/ VPN] client (can be omitted within VLAN-168)
 
* vnc-client like tigervnc (former tight-vnc)
 
* vnc-client like tigervnc (former tight-vnc)
 
  yum install tigervnc ''or'' apt-get install tigervnc-viewer
 
  yum install tigervnc ''or'' apt-get install tigervnc-viewer
Line 41: Line 53:
 
* java enabled web-browser to run an unsigned applet (which normally causes troubles)
 
* java enabled web-browser to run an unsigned applet (which normally causes troubles)
  
===work-flow===
+
===work-flow===  
Make sure to be within the university network. If working from home, establish a [https://zid.univie.ac.at/en/services/services-from-a-z/v/vpn-virtual-private-network/ VPN tunnel] to begin with.  
+
# Establish a [https://zid.univie.ac.at/en/services/services-from-a-z/v/vpn-virtual-private-network/ VPN tunnel] to begin with.  
connecting through a virtual deskstop another username/password pair is necessary. Your username is mapped to the port:=5900+<Display> number, your password is just the same.
+
#: Make sure to be within the VPN university subnet.
start your vnc-client on your laptop
+
# start your vnc-client
 +
(Technically, connecting through a virtual desktop another username/password pair would be necessary.) Your username is mapped to the port:=5900+<Display> number, your password is just the same anyway.)
 
  vncviewer 131.130.97.100:port
 
  vncviewer 131.130.97.100:port
 
or - even better tunnel the session through ssh
 
or - even better tunnel the session through ssh
Line 54: Line 67:
 
  http://calc.isor.univie.ac.at:Port
 
  http://calc.isor.univie.ac.at:Port
  
Use your Virtual Linux Desktop's terminal (e.g. gnome-terminal) and continue as described in 1). Start your calculation and close the viewer. On any machine in VLAN-168 you can re-open a viewer and continue.
+
Use your Virtual Linux Desktop's terminal (e.g. gnome-terminal) and continue as described in 1). Start your calculation and close the viewer. Within the VPN uni-subnet or VLAN-168 you can re-open a viewer and continue.
 +
===Bugs===
 +
Avoid switching to full-screen, because vnc might get into troubles.
  
 
==Applications==
 
==Applications==
 
===Matlab===
 
===Matlab===
 
Open a terminal via e.g. '''Application > Favorites > Terminal'''. At the command-prompt put in '''matlab'''. After the licensing server is asked for authorization the GUI starts up. Don't close this terminal, since it's the controlling terminal for Matlab. Alternatively press '''<Alt>+<F2>''' and fill in matlab. You can also use matlab in text mode from the command line.
 
Open a terminal via e.g. '''Application > Favorites > Terminal'''. At the command-prompt put in '''matlab'''. After the licensing server is asked for authorization the GUI starts up. Don't close this terminal, since it's the controlling terminal for Matlab. Alternatively press '''<Alt>+<F2>''' and fill in matlab. You can also use matlab in text mode from the command line.
 +
===R studio ===
 +
edit R source files in some text-editor and run it afterwards, or use ''rstudio''.
 +
you might also want to secure-copy files in your server share and run R-studio in a web browser: http://calc.vdc.ac:8787
 +
 +
===Python===
 +
some python-libs for finance have been installed on request.

Latest revision as of 13:34, 5 December 2019

The Calc server is used for remote computing. Local user accounts are provided therefore. calc.isor.univie.ac.at can be accessed in 2 ways.

Contents

[edit] 1 Functional Range

Use remote computing @calc for medium large operations. For small Operations use your laptop, for large ones Ivana's cluster. Coordinate with your colleagues, and use gkrellm to monitor system resources. (30% virtualisation-overhead might be indicated)

[edit] 2 Backup

Your data is your responsibility, since this server is not part of a BACKUP routine. Transfer your data (e.g. code and time-series) back onto your laptop or onto your share of our Institutsserver.)

[edit] 3 Access

[edit] 3.1 via Direct Access

[edit] 3.1.1 Prerequisites

  1. VPN client (no need within VLAN-168)
  2. ssh client
  3. X client

an X server is needed if graphics shall be displayed, staying in text mode you would not need it.

[edit] 3.1.2 work-flow

Your console (terminal) still controls the session, so if e.g. your laptop runs short on batteries, your calculation is interrupted and lost.

  • login at the remote host calc.isor.univie.ac.at
ssh -X <remote_user>@calc.isor.univie.ac.at

the first time you might want to check the host-keys:

a6:b2:e6:b2:69:79:03:2d:dc:a8:32:f3:9d:36:b1:e3   (ECDSA)
31:9a:05:c8:02:83:58:da:4e:3a:92:36:8c:89:29:c4   (RSA)
  • make your data available
    • either by running a script to connect your vladimir-data

(only if you have got an account at the institutsserver, i.e. being staff)

mount_vladimir <vladimir_user>
  • or some secure-copy transfers
scp -r <my_local_data> <remote_user>@calc.isor.univie.ac.at
  • start your calculations, e.g
matlab
  • transfer your outcome and delete your original data (if you don't use it any more)

or disconnect from vladimir

umount_vladimir

[edit] 3.2 via Virtual Desktop

caption

you can use a virtual desktop to login the calc server.

  1. F5 for connecting to the UNI-VPN
  2. vncviewer to connect to your Desktop

[edit] 3.3 via sftp and WEB-R

  1. F5 for connecting to the UNI-VPN
  2. sftp (e.g. FileZilla) to upload your workspace
  3. http://calc.vdc.ac:8787 to do your R

[edit] 3.3.1 Prerequisites

  • VPN client (can be omitted within VLAN-168)
  • vnc-client like tigervnc (former tight-vnc)
yum install tigervnc or apt-get install tigervnc-viewer
or similar viewers for windows, etc.

or

  • java enabled web-browser to run an unsigned applet (which normally causes troubles)

[edit] 3.3.2 work-flow

  1. Establish a VPN tunnel to begin with.
    Make sure to be within the VPN university subnet.
  2. start your vnc-client

(Technically, connecting through a virtual desktop another username/password pair would be necessary.) Your username is mapped to the port:=5900+<Display> number, your password is just the same anyway.)

vncviewer 131.130.97.100:port

or - even better tunnel the session through ssh

vncviewer -via <remote-user>@calc.isor.univie.ac.at localhost:port

Best to use the Full-Screen-Mode, note the keys how to escape, e.g. <Strg> + <Alt> + <Shift> + <F> Don't forget to close the vncviewer before opening it at another host to get the geometry-settings right. Some viewers like viagre disable sending special keys by default (<Strg>+<Q> in this case). Make sure to enable them, just not to get locked out in FullScreen mode.

If you use a java-enabled web-browser and allow an unsigned applet to run, calculate your Port := 5800+<Display>

http://calc.isor.univie.ac.at:Port

Use your Virtual Linux Desktop's terminal (e.g. gnome-terminal) and continue as described in 1). Start your calculation and close the viewer. Within the VPN uni-subnet or VLAN-168 you can re-open a viewer and continue.

[edit] 3.3.3 Bugs

Avoid switching to full-screen, because vnc might get into troubles.

[edit] 3.4 Applications

[edit] 3.4.1 Matlab

Open a terminal via e.g. Application > Favorites > Terminal. At the command-prompt put in matlab. After the licensing server is asked for authorization the GUI starts up. Don't close this terminal, since it's the controlling terminal for Matlab. Alternatively press <Alt>+<F2> and fill in matlab. You can also use matlab in text mode from the command line.

[edit] 3.4.2 R studio

edit R source files in some text-editor and run it afterwards, or use rstudio. you might also want to secure-copy files in your server share and run R-studio in a web browser: http://calc.vdc.ac:8787

[edit] 3.4.3 Python

some python-libs for finance have been installed on request.

Personal tools
Namespaces

Variants
Actions
Navigation
Tools