Vanderbilt University Big Data Application Developer (ACCRE) in Nashville, Tennessee

Big Data Application Developer (ACCRE) (Job Number: 1900033)


The Big Data Application Developer will focus on software development and programming and user support for the ACCRE research community, in particular the CMS Tier 2 project. This position does not have supervisory responsibility; the position reports functionally and administratively to the associate director.

The Advanced Computing Center for Research and Education (ACCRE) is built and operated by Vanderbilt faculty. Its mission is to allow Vanderbilt researchers to define, benefit from, and explore the "New World" described above. Towards this aim, the center has established the following goals:

  • Low Barriers:provide computational services with low barriers to participation, workingwith researchers to develop and adapt HPC tools to their avenues ofinquiry,

  • Expand theParadigm: work with members of the Vanderbilt community to find new andinnovative ways to use computing in the humanities, arts, and education,

  • PromoteCommunity: foster an interacting community of researchers and develop acampus culture that promotes and supports the use of HPC tools.

The center runs a >9,000 processor core Linux cluster comprised of multiple architectures and manages over 6 petabytes of parallel access, fault tolerant, distributed disk storage.

Duties and Responsibilities :

Serves as a lead developer andmaintainer of CMS Tier 2 project:

  • Manages gridinfrastructure in support of large DOE CMS Tier 2 project.

  • Updates andmonitors various data storage, transfer, and processing pipelines in useby the CMS project.

  • Works withother local admins to ensure high site reliability and availability.

  • Participatesin weekly meetings with Vanderbilt researchers active in the CMS project.

  • Serves as alead developer/maintainer for ACCRE’s Jupyter environment:

  • Develops andmaintains JupyterHub environment for Vanderbilt and CMS researchers

  • Exploresusing, configuring, and optimizing tools from the Hadoop Ecosystem,including HDFS, MapReduce and Spark

  • Plans andexecutes the deployment of a cluster environment optimized for Big Dataanalysis and provide ease of access and use for Vanderbilt researchers.

  • Assistsresearchers in porting existing software tools to the Big Dataenvironment.

  • Meets withresearchers to explain benefits of new environment.

  • Developsdocumentation for using tools on Jupyter cluster.

  • Developstraining course(s).

  • Trains ACCREstaff in using tools from Jupyter ecosystem.

Provides research support toVanderbilt researchers:

  • Assistsresearchers with developing research software tools that can leverage theparallel architecture available on the ACCRE cluster.

  • Encouragesknowledge sharing between users, such as the sharing of scripts used onthe cluster.

  • EncouragesVanderbilt researchers to include support for the center in their researchproposals and provide them with the necessary text and information.

  • Contributes toand develops research proposals in conjunction with Vanderbilt PrincipalInvestigators which could include researching and applying for grants withco-investigators, core facility grants or developing partnerships withother local universities.

  • Teaches someof the ACCRE training workshops (series currently held twice per month)and develops new training workshops if needed.

  • Teachesmodules in Vanderbilt courses on supercomputing for undergraduate andgraduate students when needed.

  • Providesexpert technical support for users, including problem determination andresolution:

  • Providesguidance to existing and potential users on how to use ACCRE for theirresearch projects through both one-on-one and small group trainingsessions including assistance with code compiling.

  • Responds tohelp desk tickets to solve user problems and to educate users on ACCREservices.

  • Communicateseffectively with other workers and customers.

  • Maintainsfamiliarity with emerging techniques and technologies in researchcomputing.

  • Developssoftware for existing and new cluster infrastructure related developmentprojects and provides advanced support for the cluster and otherimplemented projects:

  • Researches,develops, implements, maintains, documents, and supports infrastructuretechnology and services that facilitate the management and usage of thecluster, which includes elevated end-user cluster support.

  • Developsscripts to facilitate cluster and user management and assist computersystem analysts in the creation of cluster related software applications.

  • Assistsresearchers with software issues to improve their productivity on ACCREcluster.

  • Serves asbackup on software projects managed by any other cluster staff includingscheduling software and form submission software.

Hardware Support:

  • Provideson-call support by serving as the on-call person for night and weekendhours on a rotating schedule with other staff; works occasional nightand/or weekend hours when necessitated for both scheduled and unscheduleddowntimes.

  • Supports usersby assisting cluster systems analysts on projects.

  • Helps ensurethat the cluster operates on a 24/7 basis.

  • Identifies andparticipates in training, education, and development activities to improveknowledge and performance and enhance professional development:

  • Keepsup-to-date on software systems, operation procedures, and technologicaldevelopments.

  • Researches andevaluates new technologies/concepts for ACCRE’s capabilities and/orservices.

  • Attendsmeetings, conferences, and seminars as needed.

Profile of an IdealCandidate :

  • A Bachelor’sdegree in an appropriate area of specialization from an accreditedinstitution of higher education is necessary.

  • A MS or PhD ina research field that heavily uses high-performance and/or scientificcomputing is preferred.

  • At least twoyears of experience with one or more UNIX scripting languages such asBash, Csh, or Tcsh is preferred.

  • At least twoyears of experience working in a UNIX-like environment with proficiency inusing command line tools is necessary.

  • Ability tocommunicate to researchers the value that ACCRE provides is necessary.

  • A strongunderstanding of the use of computational resources to solve scientificproblems is necessary.

  • Strongprogramming ability and understanding of commonly used design patterns is necessary.

  • At least twoyears of experience with one or more major programming languages such asC, C++, Java, or Fortran, one or more Unix scripting languages such asBash, Csh, or Tcsh, and one or more interpreted language like Perl,Python, Matlab, or R is necessary.

  • Strong workingknowledge of the following items is necessary:

  • Unix-basedoperating systems: namely RedHat-based distros.

  • Building andinstalling software in a Unix-like environment with tools like autoconf,automake, and cmake.

  • Parallelprogramming APIs like MPI, OpenMP, PThreads, CUDA, OpenACC, or OpenGL.

  • Versioncontrol software, preferably Git.

  • Containertechnologies, in particular Docker and Singularity.

  • Willingness tolearn system administration with Unix-based operating systems isnecessary.

About Vanderbilt Benefits:

In addition to offering a lively community that encourages learning and celebrates diversity, VU offers a competitive, flexible benefits package including health, dental, vision, life, accidental death & dismemberment, disability insurance, paid time off, and a 403(b) retirement plan with employer match. Vanderbilt offers tuition assistance to employees, spouses and dependent

children. Also, after five years of service, Vanderbilt will pay up to 55% of the tuition for up to three dependent children to earn a bachelor's degree. Learn more about Vanderbilt's benefits at VU Benefits Overview.

About Vanderbilt:

Vanderbilt is a renowned private institution founded in 1873 located a little more than a mile from downtown Nashville, TN. The university’s students, faculty, staff and visitors frequently cite Nashville as one of the big perks of Vanderbilt. VU is a place where your expertise will be valued, your knowledge expanded and your abilities challenged. It is a place where your diversity is sought and celebrated. It is a place where employees know they are part of something that is bigger than themselves, take exceptional pride in their work and never settle for what was good enough yesterday.

Vanderbilt University is an equal opportunity, affirmative action employer. Women, minorities, people with disabilities and protected veterans are encouraged to apply.

Primary Location: United States-Tennessee-Nashville

Organization: 27710 - Advanced Computing Center for Research and Education

Job: Information Technology Professionals

Vanderbilt University is committed to principles of equal opportunity and affirmative action