Data Engineer III
About the role
We're looking for an experienced Data Engineer to support our infrastructure work. This role would primarily be responsible for building and modifying complex pipelines and alerting systems for our legal team. We'd ideally like to find someone who has experience working on data warehousing and building (plus leading end-to-end projects to build) high-complexity monitoring and alerting systems. We're a very XFN-heavy team, so someone who is very communicative, collaborative, comfortable navigating ambiguity / tenacious in finding answers, and cognizant of privacy/security would do very well in this role.
Responsibilities
- Building ETL pipelines: Engineers are responsible for scheduling and querying massive tables, ensuring efficient data extraction and transformation.
- Collaborating with attorneys: Work closely with attorneys and Data Scientists to understand what data is needed, where it is located, when it is required, and which tables are relevant.
- Cross-functional collaboration: Collaborate with various XFN teams to launch new systems and products. Responsibilities include preparing documentation, coordinating with multiple stakeholders, developing a plan for system building, identifying collaborators, and ensuring successful execution.
- Participate in OP monthly team meetings and participate in team-building efforts.
- Contribute to OP technical discussions, peer reviews, etc.
- Contribute content and collaborate via the OP-Wiki/Knowledge Base.
- Provide status reports to OP Account Management as requested.
Requirements
- Expert-level SQL (Presto, Postgres, MySQL, etc.- any form is fine).
- Expert-level Python.
- Expert-level proficiency using pipelining tools (e.g., Airflow, Dataswarm, etc).
- Experience leading DE efforts on large XFN projects with a wide variety of technical and non-technical stakeholders.
- Expert-level communication.
- Demonstrated experience using AI to expedite project delivery (or even better--building AI components to help automate workflows for non-technical stakeholders).
- Experience working on projects for highly regulated industries (e.g., legal, compliance, finance, security, privacy, etc).
- Experience mentoring junior team members.
- Experience working in startups / ambiguous environments with a broader scope of work.
- Big-tech experience not necessary; non-traditional backgrounds are welcome.
Benefits
- 401(k)
- Dental Insurance
- Health insurance
- Vision insurance
About Us
At OP, we help you harness the power of technology for maximum impact. A technology consulting and solutions company, we offer advisory and managed services, innovative platforms, and staffing solutions across a wide range of fields including AI, cyber security, enterprise architecture, and beyond. For nearly two decades, we ve been challenging the status quo of the consulting industry, serving up fresh, ingenious thinking through a radically lean structure. Together, this strategy delivers unprecedented performance at an unparalleled pace for faster results that propel your business forward.