Operational Environments

Overview

This procedure is intended for users of the Rubin Observatory that are interested in interacting with the Observatory Control System. It contains basic information (with links and description) on how to connect to the observing interface tools at the summit and at the different test stands.

  • Each operational environment is composed of a nublado instance, an EFD instance (with Chronograf and other visualization tools) and LOVE interface.
  • Coordination on the use of each operational environment is managed through Slack channels.
  • Most components are deployed as docker containers, orchestrated via ArgoCD and Kubernetes. A small subset of components are deployed with docker-compose and, in some cases, deployment is still done directly on bare metal nodes manually.

Prerequisites

  • You must be logged on the LSST-WAP, into the NOAO or summit VPN.

Post-Condition

  • Successfully access nublado and other observing interface tools.
  • Ability to command components.

Procedure Steps

In a browser open the links below under the heading corresponding to the operational environment you want to interact with.

For instance, open the nublado link in NTS to interact with the observatory control system in that operational environment.

NCSA Test Stand (NTS)

The NTS is currently being used as a staging platform to test software deployment prior to deployment at the summit. Systems that control hardware at the Summit run here in simulation mode. Once deployment is tested here, the platform is made available for general users for training, testing and developing of control algorithm and procedures.

  • Nublado: https://lsst-nts-k8s.ncsa.illinois.edu/

  • Chronograf: https://lsst-chronograf-nts-efd.ncsa.illinois.edu/

  • LOVE:

    • Run the following line which will open a tunnel and allow viewing of the LOVE interface from your local web-browser.

      ssh -L 8080:lsst-teststand-ts1.ncsa.illinois.edu:80 -J lsst-login03.ncsa.illinois.edu lsst-teststand-ts1.ncsa.illinois.edu

    • Use your NCSA account to login when prompted.

    • If you do not have Kerberos setup, you will be prompted for your password twice after running the command above. You can follow the ssh with Kerberos instructions to setup your computer so it does not require the password entries.

    • Once logged in, open http://localhost:8080/ on a browser.

  • ArgoCD: https://lsst-argocd-nts-efd.ncsa.illinois.edu/argo-cd For now there is only one admin account that can perform actions on this ArgoCD instance. This is going to be fixed by DM-28465.

  • Slack: ncsa-integ-teststand

Base Facility Test Stand (BTS)

BTS is a simulation operational environment running at the base facility in La Serena. The main difference between the NTS and this operational environment is that some systems will run using hardware simulators.

Hardware simulators are, in general, higher fidelity than those of pure software available at NTS. For that, BTS will be used mostly for higher fidelity testing, development and debugging. It will also be particularly useful for testing lower-level hardware interfaces.

Tucson Test Stand (TTS)

TTS is being assembled in Tucson and is still not available for use. This operational environment will be similar to that of NTS and will be used mainly for development of deployment strategies.

Summit

Summit is our main production operational environment. Systems running here will be directly controlling hardware or communicating with components that control actual hardware.

Important

In the case of the Summit it is required to have personnel present at the site prior to any activity that involves moving hardware. These must be planned activities and require an accompanying summit activity project Jira ticket organized by appropriate personnel.

Troubleshooting

If you can not open the links to the operational environment you intend to work with, make sure you are connected to the LSST-WAP wifi network in one of the designed areas (Tucson, La Serena or Summit facilities) or that you are connected to the NOAO VPN.

If problems persist, you can ask for help in the designated Slack channels or in the com-square channel.

Contact Personnel

This procedure was last modified Nov 10, 2021.

This procedure was written by Tiago Ribeiro. The following are contributors: Michael Reuter, Patrick Ingraham.