811523 Software Engineer $225,000.00

Position requires a Top Secret (TS/SCI) Clearance with a Polygraph.

About the role

We have an immediate need for an ETL developer to play a pivotal role in shaping, leading, and implementing cutting-edge data flow solutions centered around Apache NiFi. The candidate will provide technical expertise and support in the design, development, implementation, and testing of customer tools and applications in support of Extracting, Transforming, and Loading (ETL) of data into an enterprise Data Lake. Based in a DevOps framework, the ETL Developer participates in and directs major deliverables of projects through all aspects of the software development lifecycle.

Responsibilities

• Architecting complex NiFi data pipeline design: Design and develop enterprise-level ETL architectures and implement NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources.
• Performance optimization and tuning: Optimize NiFi data flows, including processor tuning, memory management, and load balancing, ensuring optimal performance for batch and real-time processing.
• Advanced troubleshooting and problem resolution: Identify, diagnose, and resolve complex NiFi data flow issues, including performance bottlenecks, data discrepancies, and integration failures.
• Integrating with big data and cloud technologies: Seamlessly integrate NiFi with various databases, big data ecosystems, and cloud platforms (e.g., AWS, OCI, Azure), demonstrating expertise in relevant services (e.g., Kafka, Elasticsearch, S3, SQS/SNS).
• Defining best practices and standards: Establish best practices for NiFi development, deployment, security, and governance, ensuring adherence to enterprise-wide data management policies.
• Documentation and knowledge sharing: Create and maintain comprehensive documentation for NiFi data flows, mappings, architectures, and standard operating procedures, ensuring knowledge transfer and promoting efficient team operations.
• Collaboration and communication: Collaborate effectively with data architects, data engineers, application/service developers, and other stakeholders to translate business requirements into robust technical solutions and effectively communicate complex technical concepts to both technical and non-technical audiences.
• Mentorship and team leadership: Mentor junior developers, provide technical guidance, conduct code reviews, and foster a collaborative learning environment.

Requirements

• In-depth experience designing, developing, and managing complex NiFi data flow solutions in large-scale enterprise environments.
• In-depth knowledge of NiFi architecture, processors, and configurations, along with hands-on experience with NiFi Registry and clustering for high availability and scalability.
• Proficiency in programming languages like Java and Python for custom NiFi processor development and scripting for automation.
• Proficiency writing and optimizing complex queries, along with experience in managing relational and NoSQL databases (e.g., Postgres, Elasticsearch, DynamoDB).
• Direct experience with real-time streaming and API integration (REST) for seamless data connectivity.
• Direct experience with cloud platforms like AWS, Azure, or OCI and related data services.
• Strong ability to analyze complex data challenges, identify root causes, and implement effective solutions.
• Strong ability to collaborate effectively with cross-functional teams, articulate technical concepts clearly, and provide effective mentorship.
• HS diploma and at least 16 years of relevant experience; or BS degree and at least 12 years of relevant experience; or Master’s degree and at least 10 years of relevant experience.

Preferred Qualifications

• In-depth experience deploying ETL solutions in an AWS environment.

Pay

Up to $225,000.00 per year

Schedule

Core hours: 9am to 4pm

Benefits

• Retirement
  • Full Vanguard 401k Plan with a full scope of investment options
  • 100% employer-matched contribution up to 6% of employee's salary
  • Ability to max out 401k savings ($57k, or $63.5k if over 50)
  • Employees receive B4Corp phantom stock each year (2-year vesting period)
• Insurance
  • Medical: United Health Care (UHC) with multiple plan options
  • Dental: United Concordia (UC) Flex Plan
  • Vision: Vision Service Plan Insurance Co (VSP) Signature Plans
  • Short-term disability: Mutual of Omaha (60% of salary up to $2,000.00/week)
  • Long-term disability: Mutual of Omaha (60% of salary up to $10,000.00/month)
  • Life insurance: Mutual of Omaha ($200,000.00)
• Paid Time Off (PTO)
  • Seven weeks of leave per year (including ten federal holidays)
  • Flexible work schedule with comp time (with customer approval)
• Employee Referral Bonus
  • Refer a friend or coworker and receive $3,000 per year for every year the person works for B4Corp