Data Engineer - Python

Responsibilities

• Focus on continued build out/improvement of the current data stores (Oracle, CEPH, and possibly MongoDB) including data access and persistence
• Propose enhancements to existing data pipelines and structures
• Ensure the reliability and efficiency of data processes

Requirements

• Prior knowledge/experience with database concepts such as SQL tuning, indexes, views, stored procedures, etc
• Proficient in fundamental algorithms and data structures
• Server-side Python processes utilizing concurrency patterns with asyncio, multi-processing, and threading
• Comfortable working with Numpy, Pandas, Python collections, etc
• Mastery of typical software development life cycle and deployment processes
• Experience with GIT, MS Azure DevOps, Artifactory, etc
• Must be comfortable building CI/CD pipelines
• Experience with Red Hat Enterprise Linux (RHEL) environments

Qualifications

• Associate’s Degree preferred with 5 to 7 years demonstrated server-side development proficiency
• Bachelor’s Degree preferred with 3 to 5 years demonstrated server-side development proficiency

Skills

• Programming Languages: Python (NumPy, Pandas, Oracle PL/SQL)
• Other non-interpreted languages like Java, C++, Rust, etc.
• Design patterns: typical GOF patterns (Factory, Facade, Singleton, etc.)
• Data structures: maps, lists, arrays, etc
• SCM: solid Git proficiency, MS Azure DevOps (CI/CD)
• SQL: proficiency with Oracle indexes, SQL tuning, views, stored procedures, and functions
• OS: majority of the development is on Redhat Linux but should be comfortable with Windows
• Some Unix shell scripting may be needed from time to time
• API development: must have proficiency with HTTP REST with gRPC / sockets as a plus
• Comfortable working iteratively in a dynamic, flexible environment
• Strong self-management skills and with a focus on timely completion of tasks
• Able to converse with technical and non-technical groups