Beamline Controls Engineer

About the role

The Beamline Controls Engineer position is within the Engineering division at Lawrence Berkeley National Laboratory. This role is responsible for the computing, virtualization, network, storage, and EPICS control system infrastructure that supports ALS beamline operations.

Responsibilities

• Install, configure, and maintain Linux servers and virtualization platforms that run the beamline control systems, scientific computing, and shared services, including Proxmox VE high-availability clusters.
• Manage the configuration and capacity of these systems, and apply operating system updates, firmware updates, and security fixes across the supported machines.
• Build and maintain storage systems and the file systems behind them, including disk arrays, networked storage, and high-speed connections that move data to and from instruments.
• Maintain backup and disaster recovery systems that protect operational and experiment data.
• Manage network and access controls in the controls environment, ensuring control, research, and management traffic are separated, and running DNS, remote access, firewalls, and account and permission management.
• Use scripting and configuration management tools to automate builds and configuration, enabling systems to be rebuilt and recovered reliably.
• Write, deploy, and support EPICS control software for motors, optics, sensors, detectors, and analog and digital I/O on the beamlines. Connect commercial motion controllers, piezo and other precision actuators, and PLCs to the control system.
• Build and run data acquisition software and experiment data systems that sit on top of the control system, along with operator screens scientists use to run and watch their experiments.
• Add new instruments and devices to the group’s standard control software, solve hardware and software integration problems, and turn the results into reusable tools.
• Serve as the senior technical person for the largest and least defined infrastructure and controls problems, where there is no set procedure and the best choice depends on the effect on research and long-term system support.
• Set and maintain standards for configuration, documentation, security, and day-to-day operations, and help other staff bring their work in line with them.
• Work with beamline groups, operations, other Engineering functions, other DOE labs, and vendors to agree on shared solutions and standards, and represent the group in meetings that cross divisions and facilities.
• Give technical direction and mentoring to other staff, and when assigned, lead the technical work on a project or direct the work of others.
• Collaborate with engineers and scientists. Direct the work of other coordinators, designers, technicians, and maintenance personnel.
• Support projects by contributing to the creation of cost estimates, budgets, schedules, and the procurement of key components.
• Maintain compliance with applicable LBNL policies and standards (Engineering Process, Electrical Equipment Inspection Program, Safety Software Quality Assurance, safety protocols, respectful workplace, etc.).
• Contribute to the development of the department’s mission and committed to achieving it in a safe and respectful manner, in compliance with applicable standards and regulations.

Requirements

• Bachelor’s Degree, or equivalent, in engineering or related field.
• 12+ years of relevant technical experience with Bachelor’s degree, 8 with a Master’s degree, or equivalent experience.
• Extensive experience building and running Linux server, virtualization, storage, and network infrastructure in a scientific or research computing environment that runs continuously.
• Strong hands-on Linux systems engineering, including security hardening and managing servers through their full life, from build to retirement.
• Experience running virtualization and clusters for production work, with shared storage and high availability. Proxmox VE experience applies directly.
• Solid storage and file system work, including disk arrays, networked storage, high-speed I/O, and backup and recovery that has been tested.
• Practical networking and access control in a network that is segmented and used for several purposes, including routing, VLANs, DNS, VPN, firewalls, and account and permission management.
• Good scripting and configuration management skills for automation, for example Python and shell with a configuration management tool such as Puppet or Ansible.
• Knowledge of system monitoring, and a track record of keeping systems running at high availability around the clock.
• Good independent judgment on significant and new high-stakes problems, and the ability to work with separate groups and outside organizations to agree on solutions and standards.
• Able to explain complex technical choices clearly to scientists, engineers, and management.

Qualifications

• Experience with EPICS instrument control and data acquisition; experience supporting a synchrotron, accelerator, or large scientific user facility; experience connecting motion control, detectors and cameras, and PLC I/O to a control system.
• EPICS instrument control, including motion control with commercial controllers and precision actuators, and connecting detectors, cameras, and PLC I/O.
• Data acquisition software and operator screen development in Python and in web front ends.
• Relational and in-memory database administration.
• Cloud and container experience.
• Experience at a synchrotron, accelerator, or other large scientific user facility, or at a DOE lab.

Skills/Knowledge

• Experience with EPICS instrument control and data acquisition; experience supporting a synchrotron, accelerator, or large scientific user facility; experience connecting motion control, detectors and cameras, and PLC I/O to a control system.
• EPICS instrument control, including motion control with commercial controllers and precision actuators, and connecting detectors, cameras, and PLC I/O.
• Data acquisition software and operator screen development in Python and in web front ends.
• Relational and in-memory database administration.
• Cloud and container experience.
• Experience at a synchrotron, accelerator, or other large scientific user facility, or at a DOE lab.

Benefits

At Lawrence Berkeley National Laboratory, we offer exceptional benefits including exceptional health and retirement benefits, opportunities to grow in your career, and a culture where you'll belong. We also offer a Winter Holiday Shutdown every year, parental bonding leave, pet insurance, and more.

Pay

The expected salary for this position is $179,000 - $218,000, which fits into the full salary range of $158,808 - $267,996 depending upon the candidate’s skills, knowledge, and abilities. This includes education, certifications, and years of experience.

Schedule

This is a full-time career appointment, exempt (monthly paid) from overtime pay.