ETL Developer
About the role
Vantor is seeking an experienced ETL Developer to support a geospatial visualization platform. The role involves designing, developing, and managing ETL workflows using Apache NiFi to ensure reliable data flow into a PostgreSQL database.
Responsibilities
- Design, develop, and manage ETL workflows using Apache NiFi to support a geospatial visualization platform
- Learn the nuances of the existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues
- Develop new NiFi flows that adopt best practices of existing NiFi flows
- Take feedback on NiFi flows and develop requested changes
- Interface with analysts via email, chat, and in person meetings to comprehend future data flow needs and refine general requirements into specific actions
- Gain competency in geospatial database design and employ best practices for table creation, indexing, and unique constraints
- Programmatically manipulate and transform data from multiple sources
- Query and analyze large datasets using SQL
- Retrieve and process data from external systems via APIs
- Support data quality, integrity, and performance optimization efforts
- Understand Python and data science frameworks while differentiating between experimental prototypes and enterprise level software requirements
- Develop Python in support of data science related efforts or ETL prototypes
Requirements
- Experience: Bachelor’s degree with 8+ years of relevant experience, OR Master’s degree with 7+ years of experience, OR Doctorate with 6+ years of experience
- Active TS/SCI clearance with required polygraph
- U.S. Citizenship required
- Willingness to work onsite full-time
- Strong understanding of ETL concepts and best practices
- Strong experience with databases for data management
- Proficiency in SQL for querying large datasets
- Experience with API integration and data retrieval
- Demonstrated experience with programmatic data manipulation
- Competency to rapidly adopt containerized development proficiency
- Competency to rapidly adopt AWS architecture proficiency
- Competency to rapidly adopt NiFi registry and Git for code management
- Competency to rapidly adopt Git and repository actions and pull requests
- Competency to rapidly adopt Python for data manipulation and API interfacing
- Understanding of basic data science concepts and tools
Qualifications
- Minimum Qualifications: Bachelor’s degree with 8+ years of relevant experience, OR Master’s degree with 7+ years of experience, OR Doctorate with 6+ years of experience
- Preferred Qualifications: Creativity to experiment and recommend best practice coding improvements, Drive to adopt and recommend AI into development processes, Experience with AWS cloud services for data ingestion and processing, Hands-on experience with Apache Airflow, Hands-on experience with Apache NiFi, Hands-on experience with NiFi registry and Git, Hands-on experience with Git and repository actions and pull requests, Hands-on experience in Python for data manipulation and API interfacing, Understanding of basic data science concepts and tools
Pay
The base pay for this position within the Washington, DC metropolitan area is: $113,000.00 - $188,000.00 annually. For all other states, we use geographic cost of labor as an input to develop market-driven ranges for our roles, and as such, each location where we hire may have a different range.
Benefits
Vantor offers a competitive total rewards package that goes beyond the standard, including a robust 401(k) with company match, mental health resources, and unique perks like student loan repayment assistance, adoption reimbursement and pet insurance to support all aspects of your life. You can find more information on our benefits at: https://www.Vantor.com/careers