Data Engineer
About the role
GRVTY’s team provides tactical data engineering solutions. We embed skilled Data Engineers, Data Scientists, and ETL Developers directly into intelligence analyst groups to be their go-to data wranglers. We develop new tools, code, and services to execute data engineering activities. Our engineers work to collect, process, and feed analytic tools, turning data into intelligence in response to immediate mission needs, with direct impact on real world situations.
Responsibilities
- Develop new tools, code & services to execute data engineering activities. Activities include the following tasks:
- Movement of structure & unstructured data using approved methods.
- Execute data ingestion activities for storing data in a local or enterprise level location.
- View data in its source format.
- Develop code to format data that supports exploration.
- Analyze source data formats & work with Data Scientists & partners to determine the formats & transforms that best meet mission objectives.
- Develop code and tools to provide one-time & on-going data formatting & transformations into enterprise or boutique data models.
- Implement existing ETL code & best practices/standards.
- Develop an ETL Code Transition Plan.
- Develop & deliver documentation for each project including ETL mappings, code use guide, code location & access instructions.
- Facilitate Code Reviews.
- Provide consulting services to support data transport, ingestion, conditioning, access, & management.
Requirements
- Active TS/SCI with Polygraph Clearance
- Ability and willingness to quickly learn a new tool
- Strong communication skills with both your teammates, and your leads
- SQL, Python, Pyspark experience.
- Willingness to do development type work when needed (junior level development at best)
- Ability to be a self starter and ask questions when needed
- Comfortable working with and manipulating data in compliance with the offices workflow
- Extract, Transform and Load (ETL) tools and processes.
- AWS
- Linux
- Geospatial tools/data
Qualifications
- Palantir Foundry Experience
- Kubeflow
- Experience with OCR and text extraction of PDFs.
- Experience with data validation / data quality after ETLing to be sure it’s ready for end users
- Docker
- Jenkins
- Hadoop/Spark
- Kibana
- Kafka
- NiFi
- ElasticSearch
Benefits
We're proud to offer a work environment that empowers our team to achieve a strong work-life balance. GRVTY provides competitive pay, comprehensive benefits, and meaningful opportunities for professional growth.
- Robust health plan including medical, dental, and vision
- Health Savings Account with company contribution
- Annual Paid Time Off and Paid Holidays
- Paid Parental Leave
- 401k with generous company match
- Training and Development Opportunities
- Award Programs
- Variety of Company Sponsored Events
Pay
Virginia Pay Range
$150,000 - $200,000 USD
Why Choose GRVTY
The toughest national security challenges demand vision and ingenuity, not just resources. We deliver mission and technical expertise to outpace our adversaries. We’re purpose-built to tackle the most entrenched, systemic national security issues around the world.
EEO Statement
GRVTY, is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran and will not be discriminated against on the basis of disability.