Difference between revisions of "Ifarm graphic mode"

From Hall A Wiki
Jump to: navigation, search
(vnc (recommended))
(start vnc server)
 
(23 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
For any question, email Zhiwen Zhao zwzhao at jlab.org
 +
 
= Why =
 
= Why =
 
Usually we are running code on ifarm without caring about graphic because it's used for a test ground for farm job anyway.
 
Usually we are running code on ifarm without caring about graphic because it's used for a test ground for farm job anyway.
Line 4: Line 6:
 
Sometimes we do want to test a code's graphic feature. For example, it's a common system we all have access and can be used for debug.
 
Sometimes we do want to test a code's graphic feature. For example, it's a common system we all have access and can be used for debug.
  
= Xwindow forwarding (not recommended) =
+
= Xwindow forwarding (when your computer is inside jlab network, otherwise this might be too slow) =
  
One way to do it is simply use Xwindow forwarding by ssh into ifarm and run the code.
+
It is simply use Xwindow forwarding by ssh into ifarm and run the code.  
but the problem is that Xwindow graphic is always rendered in your local machine. So not only the test can have different results for different people because their local machines are different. Sometimes, it can cause crash of your local machine if your code is not nice and your local machine is very different from ifarm.
+
  
  if your local machine is linux or Mac which has Xwindows
+
Xwindow graphic is always rendered in your local machine. This is not only very slow if your machines is outside of jlab network, but also can have different results for different people because their local machines are different. Sometimes, it can even cause crash of your local machine if your code is not nice and your local machine is very different from ifarm.
  ssh -XY your_lab_username@ifarm          (login with Xwindow forwarding enabled)
+
 
 +
  ssh -XY your_lab_username@ifarm          (login with Xwindow forwarding enabled for linux and Mac)
 
  xclock &                                (test if Xwindow forwarding works)                                             
 
  xclock &                                (test if Xwindow forwarding works)                                             
  
  If you local machine is windows, you need to enable Xwindows forwarding in [http://www.chiark.greenend.org.uk/~sgtatham/putty/latest.html putty] option and have a Xwindow server like [https://sourceforge.net/projects/xming/files/Xming-mesa/ Xming-mesa] running.  
+
  If you local machine is windows, you need to have a Xwindow server like [https://sourceforge.net/projects/xming/files/Xming-mesa/ Xming-mesa] running. You also you need to enable Xwindows forwarding in [http://www.chiark.greenend.org.uk/~sgtatham/putty/latest.html putty] option to use ssh
then test if "xclock" works
+
  
= vnc (recommended) =
+
If you local machine is Mac, you need to have a Xwindow server installed and enabled
  
'''tested on ifarm1401 and ifarm1402 as of 2017/05'''
+
= connect to a jlab machine by vnc (recommended for access from outside jlab) =
  
The better way to do it is through a vnc inside ifarm. This way the code won't crash because it runs within the same environment where it is compiled and everyone will see same result. Here is how to do it
+
you can do it by vnc and ssh tunneling
  
First login into ifarm with Xwindow forwarding enabled   (this is to use vncviwer)
+
vncserver should run on a machine inside jlab like your machine or jlabl1,...,jlabl5. It shouldn't run inside any ifarm machine as computer center will kill it when you running too many processes on ifarm.
 +
 
 +
== start vnc server ==
 +
 
 +
First you need to start a vncserver on jlabl1 as an example
 +
 
 +
ssh -XY your_lab_username@jlabl1.jlab.org (login with Xwindow forwarding enabled)
 
  mkdir .vnc
 
  mkdir .vnc
 
  edit .vnc/xstartup with lines below
 
  edit .vnc/xstartup with lines below
Line 29: Line 36:
 
         vncconfig -iconic &
 
         vncconfig -iconic &
 
         xterm -geometry 160x50+10+10 -ls -title "$VNCDESKTOP Desktop" &
 
         xterm -geometry 160x50+10+10 -ls -title "$VNCDESKTOP Desktop" &
         metacity &
+
         #metacity &
 +
        xfce4-session < /dev/null >& /dev/null &
 
  chmod 755 .vnc/xstartup
 
  chmod 755 .vnc/xstartup
  vncserver                           (start vnc server, give a password if running it first time, note the port number output on screen)
+
  vncserver -geometry 1920x1080      (start vnc server)
  vncviewer localhost:1              (use other port number if not 1 in last step)
+
or
(now you are inside ifarm and an xterm is open for you to use)
+
vncserver -bs                      (start vnc server this way if somehow quitting program root will kill vncserver)
( '''make sure to kill the server after you using it to free resource on ifarm,  
+
('''give a password if running it first time, or run vncpasswd to enter password'''
otherwise it will keep running even after you log out!''')
+
'''note the vnc server port number output on screen'''
  vncserver -kill :1                  ('''note the space before colons)
+
  '''make sure to kill the server after you using it to free resource on host,otherwise it will keep running even after you log out!'''
 +
  vncserver -kill :port        (replace port with correct vnc server port number,'''note the space before colons''')
 +
 
 +
if you have another good machine at jlab to use as vnc server, you can use gnome or kde desktop system in xstartup as follows
 +
#!/bin/sh
 +
unset SESSION_MANAGER
 +
unset DBUS_SESSION_BUS_ADDRESS
 +
/etc/X11/xinit/xinitrc
 +
#startkde &
 +
 
 +
ssh -XY -XY -N -L 5999:ifarm2401:22 login
 +
 
 +
Next you can test to see if your vncserver runs ok. (It's slow if your machine is not at jlab network)
 +
 
 +
vncviewer localhost:port            (replace port with correct vnc server port number)
 +
 
 +
== ssh tunneling ==
 +
 
 +
To run vncviewer on your machine outside jlab, it's best by ssh tunneling
 +
 
 +
* built ssh tunnel as follows with '''correct port number of vnc server'''
 +
** if your linux or mac machine is at jlab, run "ssh -X -N -g -L 5999:localhost:port your_lab_username@jlabl1.jlab.org"
 +
** if your linux or mac machine is outside jlab, run "ssh -X -N -g -L 5922:jlabl1:22 your_lab_username@login.jlab.org" and run in another terminal "ssh -X -N -g -L 5999:localhost:port your_lab_username@localhost -p 5922"  (both terminals will just stay there without allowing you to input anything and you keep both alive.)
 +
** if you windows machine is at jlab, use putty to connect to jlabl1.jlab.org:22 by add Connection->SSH->Tunnels with source port 5999 and destination localhost:port"
 +
** if you windows machine is outside jlab, use putty to connect to login.jlab.org by add Connection->SSH->Tunnels with source port 5922 and destination jlabl1:22" and another putty to connect to localhost:5922 by add Connection->SSH->Tunnels with source port 5999 and destination localhost:port"
 +
* get a good [https://www.realvnc.com/en/connect/download/viewer/ vncviewer] or use a default one after "yum install tigervnc"
 +
* then run vncviewer and connect to localhost:5999 (choose lower graphic quality for better speed and scale to window size in option for best use)
 +
 
 +
= connect to any machine's main desktop at jlab by x11vnc  =
 +
 
 +
"vncserver" create a new X server independent of the main X server.
 +
 
 +
But you can connect to main desktop by "x11vnc" and ssh tunneling as if you are sitting in front of it
 +
 
 +
at the remote host,
 +
if x11vnc is not installed, run "yum install x11vnc" as root to install it. If you have ssh key on login server or your remote host, disable it temporarily by renaming .ssh/authorized_keys.
 +
as an example, start x11vnc in the machine called testmachine.jlab.org as follows
 +
run "x11vnc -localhost -auth guess -display :0 -repeat -shared -forever -rfbport 5900 &"
 +
It's preferred to run it as root so that you can do vnc even before login after computer boots.
 +
If you don't have root access, just run it as regular user, but sometime it fails after computer reboot because xwindow auth can't be established. then the fix is usually that you have to login in front of your computer first
  
In principle, we don't need Xwindow forwarding to use vncviewer on ifarm. We could use a local vncviewer and ssh tunneling for better performance. This can be important if you are not on jlab internal network. ask me and I can write a howto if nessary
+
at your local machine, as an example,connect to host testmachine from your machine outside jlab as follows
 +
For linux or mac, run in a terminal "ssh -X -N -g -L 5922:testmachine:22 your_lab_username@login.jlab.org", then run in another terminal "ssh -X -N -g -L 5999:localhost:5900 your_lab_username@localhost -p 5922" (both terminals will just stay there without allowing you to input anything and you keep both alive.)
 +
For windows, use putty to connect to login.jlab.org by add Connection->SSH->Tunnels with source port 5922 and destination testmachine:22" and another putty to connect to localhost:5922 by add Connection->SSH->Tunnels with source port 5999 and destination localhost:5900"
 +
The first ssh tunneling connect your localhost:5922 to testmachine:22 through login:22 and the second ssh tunneling connect your localhost:5900 to testmachine:5900 through localhost5922 which is actually testmachine:22
  
For any question, email Zhiwen Zhao zwzhao@jlab.org
+
at your local machine, get [https://www.realvnc.com/en/connect/download/viewer/ vncviewer]
 +
then run vncviewer and connect to localhost:99
 +
choose lower graphic quality for better speed and scale to window size in option for best use

Latest revision as of 19:06, 10 April 2025

For any question, email Zhiwen Zhao zwzhao at jlab.org

Why

Usually we are running code on ifarm without caring about graphic because it's used for a test ground for farm job anyway.

Sometimes we do want to test a code's graphic feature. For example, it's a common system we all have access and can be used for debug.

Xwindow forwarding (when your computer is inside jlab network, otherwise this might be too slow)

It is simply use Xwindow forwarding by ssh into ifarm and run the code.

Xwindow graphic is always rendered in your local machine. This is not only very slow if your machines is outside of jlab network, but also can have different results for different people because their local machines are different. Sometimes, it can even cause crash of your local machine if your code is not nice and your local machine is very different from ifarm.

ssh -XY your_lab_username@ifarm          (login with Xwindow forwarding enabled for linux and Mac)
xclock &                                 (test if Xwindow forwarding works)                                            
If you local machine is windows, you need to have a Xwindow server like Xming-mesa running. You also you need to enable Xwindows forwarding in putty option to use ssh
If you local machine is Mac, you need to have a Xwindow server installed and enabled

connect to a jlab machine by vnc (recommended for access from outside jlab)

you can do it by vnc and ssh tunneling

vncserver should run on a machine inside jlab like your machine or jlabl1,...,jlabl5. It shouldn't run inside any ifarm machine as computer center will kill it when you running too many processes on ifarm.

start vnc server

First you need to start a vncserver on jlabl1 as an example

ssh -XY your_lab_username@jlabl1.jlab.org (login with Xwindow forwarding enabled)
mkdir .vnc
edit .vnc/xstartup with lines below
        #!/bin/sh
        xsetroot -solid grey
        vncconfig -iconic &
        xterm -geometry 160x50+10+10 -ls -title "$VNCDESKTOP Desktop" &
        #metacity &
        xfce4-session < /dev/null >& /dev/null &
chmod 755 .vnc/xstartup
vncserver  -geometry 1920x1080      (start vnc server)
or
vncserver -bs                       (start vnc server this way if somehow quitting program root will kill vncserver)
(give a password if running it first time, or run vncpasswd to enter password
note the vnc server port number output on screen
make sure to kill the server after you using it to free resource on host,otherwise it will keep running even after you log out!
vncserver -kill :port         (replace port with correct vnc server port number,note the space before colons)
if you have another good machine at jlab to use as vnc server, you can use gnome or kde desktop system in xstartup as follows
#!/bin/sh
unset SESSION_MANAGER
unset DBUS_SESSION_BUS_ADDRESS
/etc/X11/xinit/xinitrc
#startkde &
ssh -XY -XY -N -L 5999:ifarm2401:22 login

Next you can test to see if your vncserver runs ok. (It's slow if your machine is not at jlab network)

vncviewer localhost:port            (replace port with correct vnc server port number)

ssh tunneling

To run vncviewer on your machine outside jlab, it's best by ssh tunneling

  • built ssh tunnel as follows with correct port number of vnc server
    • if your linux or mac machine is at jlab, run "ssh -X -N -g -L 5999:localhost:port your_lab_username@jlabl1.jlab.org"
    • if your linux or mac machine is outside jlab, run "ssh -X -N -g -L 5922:jlabl1:22 your_lab_username@login.jlab.org" and run in another terminal "ssh -X -N -g -L 5999:localhost:port your_lab_username@localhost -p 5922" (both terminals will just stay there without allowing you to input anything and you keep both alive.)
    • if you windows machine is at jlab, use putty to connect to jlabl1.jlab.org:22 by add Connection->SSH->Tunnels with source port 5999 and destination localhost:port"
    • if you windows machine is outside jlab, use putty to connect to login.jlab.org by add Connection->SSH->Tunnels with source port 5922 and destination jlabl1:22" and another putty to connect to localhost:5922 by add Connection->SSH->Tunnels with source port 5999 and destination localhost:port"
  • get a good vncviewer or use a default one after "yum install tigervnc"
  • then run vncviewer and connect to localhost:5999 (choose lower graphic quality for better speed and scale to window size in option for best use)

connect to any machine's main desktop at jlab by x11vnc

"vncserver" create a new X server independent of the main X server.

But you can connect to main desktop by "x11vnc" and ssh tunneling as if you are sitting in front of it

at the remote host, 
if x11vnc is not installed, run "yum install x11vnc" as root to install it. If you have ssh key on login server or your remote host, disable it temporarily by renaming .ssh/authorized_keys.
as an example, start x11vnc in the machine called testmachine.jlab.org as follows
run "x11vnc -localhost -auth guess -display :0 -repeat -shared -forever -rfbport 5900 &"
It's preferred to run it as root so that you can do vnc even before login after computer boots. 
If you don't have root access, just run it as regular user, but sometime it fails after computer reboot because xwindow auth can't be established. then the fix is usually that you have to login in front of your computer first
at your local machine, as an example,connect to host testmachine from your machine outside jlab as follows
For linux or mac, run in a terminal "ssh -X -N -g -L 5922:testmachine:22 your_lab_username@login.jlab.org", then run in another terminal "ssh -X -N -g -L 5999:localhost:5900 your_lab_username@localhost -p 5922" (both terminals will just stay there without allowing you to input anything and you keep both alive.)
For windows, use putty to connect to login.jlab.org by add Connection->SSH->Tunnels with source port 5922 and destination testmachine:22" and another putty to connect to localhost:5922 by add Connection->SSH->Tunnels with source port 5999 and destination localhost:5900"
The first ssh tunneling connect your localhost:5922 to testmachine:22 through login:22 and the second ssh tunneling connect your localhost:5900 to testmachine:5900 through localhost5922 which is actually testmachine:22 
at your local machine, get vncviewer
then run vncviewer and connect to localhost:99
choose lower graphic quality for better speed and scale to window size in option for best use