Software Engineer III- Python, Databricks
for sections like About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. We must include only sections that have real specific content.
We need to parse the job description.
Key parts:
- Job Description Description for Internal Candidates Commercial Banking IT is working on a strategic top priority initiative called Client 360 and working on building a CIB wide Marketing and Events Data Platform. We are looking for Big Data Software Engineer with skills and experience implementing platform to large-scale processing on internal as well as public cloud. This individual will work on groundbreaking work to implement new platform for Marketing and Events for Client 360 and also enhance the existing platforms. As a member of our Software Engineering Group we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
That's about the role (maybe "About the role").
- Responsibilities: list bullet points after "Responsibilities". The text: "Acquire data from primary or secondary data sources Identify, analyze, and interpret trends or patterns in complex data sets Transforming existing ETL logic on AWS Platform or Data Bricks Innovate new ways of managing, transforming and validating data Implement new or enhance services/scripts Establish and enforce guidelines to ensure consistency, quality and completeness of data assets Apply quality assurance best practices to all work products Analyze, design and code business-related solutions, as well as core architectural changes, using an Agile programming approach resulting in software delivered on time and in budget; Experience of working in a development teams, using agile techniques and Object Oriented development and scripting languages, is preferred Comfortable learning cutting edge technologies and applications to greenfield project"
We need to split into bullet list items. We'll create - for each.
- Qualifications: after "Qualifications This role requires a wide variety of strengths and capabilities, including:" then a list of bullet points. We'll capture each line.
- About Us: maybe not needed as a section? Could be "About the company" but not required headings list includes About Us? Not in list. The allowed headings: About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. We can map "About Us" maybe to "About the role"? Actually "About the role" is appropriate for description. "About Us" could be omitted or maybe we can include as a paragraph under "About the role"? The instruction: Use
for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule). So we can choose any of those. We'll include About the role (description), Responsibilities, Qualifications. Possibly Skills could be extracted from qualifications but we can keep Qualifications as is. No Pay, Schedule, Benefits specifics given (they mention competitive total rewards package but no specifics). So we should not create Benefits, Pay, Schedule sections because they are not specific. Also we should not create Requirements separate if we have Qualifications; but we could split Requirements and Qualifications? The posting has "Qualifications" section; we can treat that as Qualifications. No separate Requirements.
Thus output:
About the role
... (the paragraph about role)
Responsibilities
- Acquire data from primary or secondary data sources
- Identify, analyze, and interpret trends or patterns in complex data sets
- Transforming existing ETL logic on AWS Platform or Data Bricks
- Innovate new ways of managing, transforming and validating data
- Implement new or enhance services/scripts
- Establish and enforce guidelines to ensure consistency, quality and completeness of data assets
- Apply quality assurance best practices to all work products
- Analyze, design and code business-related solutions, as well as core architectural changes, using an Agile programming approach resulting in software delivered on time and in budget
- Experience of working in a development teams, using agile techniques and Object Oriented development and scripting languages, is preferred
- Comfortable learning cutting edge technologies and applications to greenfield project
Qualifications
- Advanced knowledge of application, data and infrastructure architecture disciplines
- 3+ years of Experience with Python is preferred
- 2+ years of Experience in Java Development
- 2+ Experience in a Big Data technologies (e.g. AWS, Spark, Kafka, Data Bricks etc.)
- Experience in writing efficient SQL's
- Experience in implementing complex ETL transformations on big data platform
- Strong Experience with UNIX shell scripting to automate file preparation and database loads
- Experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues
- Familiarity with relational database environment (Oracle, SQL Server, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy
- Strong development discipline and adherence to best practices and standards.
- Ability to manage multiple priorities and projects coupled with the flexibility to quickly adapt to ever-evolving business needs
- Demonstrated independent problem solving skills and ability to develop solutions to complex analytical/data-driven problems
- Must be able to communicate complex issues in a crisp and concise fashion to multiple levels of management
- Excellent interpersonal skills necessary to work effectively with colleagues at various levels of the organization and across multiple locations
- Experience in Data Science, Machine Learning and AI is a plus
- Financial Services and Commercial banking experience is a plus
- Familiarity with NoSQL platforms(MongoDB, AWS Open Search) is a plus
We should not include any fluff like "commensurate with experience". There's none.
We need to ensure we preserve all substantive information. Did we miss any? The description also mentions "As a member of our Software Engineering Group we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices." That's included in the role paragraph.
Also "You will be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals." included.
Also "We embrace a culture of experimentation and constantly strive for improvement and learning." included.
Also "You'll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally." included.
Also "About Us" paragraph: we omitted because not a required heading; but maybe we should include as part of About the role? The instruction says we can include About the role heading; we could incorporate About Us content there. But we already have About the role paragraph; we could add the About Us content as another paragraph under same heading. However the instruction: "Prefer a few substantive sections over many thin ones." So we could combine About the role and About Us under About the role heading. Let's add a second paragraph after the first about role describing the company.
Thus About the role section will have two paragraphs: first about the role, second about the company (About Us). Ensure we don't repeat job title.
Let's craft:
Commercial Banking IT is working on a strategic top priority initiative called Client 360 and working on building a CIB wide Marketing and Events Data Platform. We are looking for Big Data Software Engineer with skills and experience implementing platform to large-scale processing on internal as well as public cloud. This individual will work on groundbreaking work to implement new platform for Marketing and Events for Client 360 and also enhance the existing platforms. As a member of our Software Engineering Group we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation. JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
But note: The instruction says remove cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, and application instructions. The About Us paragraph includes EEO statements etc. That is boilerplate; we should remove that. The instruction: "Remove cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, and application instructions." So we must strip out EEO/equal-opportunity language. Also the part about "Visit our FAQs for more information about requesting an accommodation." and "JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans" is EEO boilerplate. So we should remove those sentences.
We should keep the generic description about the firm, history, offerings, total rewards package, benefits list. That's not EEO. However the sentence "We are an equal opportunity employer..." is EEO; remove. Also "We do not discriminate..." remove. Also "We also make reasonable accommodations..." remove. Also "Visit our FAQs..." remove. Also "JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans" remove.
Thus we need to edit the About Us paragraph to exclude those.
Let's rewrite About Us paragraph without EEO:
"JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's
for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule). So we can choose any of those. We'll include About the role (description), Responsibilities, Qualifications. Possibly Skills could be extracted from qualifications but we can keep Qualifications as is. No Pay, Schedule, Benefits specifics given (they mention competitive total rewards package but no specifics). So we should not create Benefits, Pay, Schedule sections because they are not specific. Also we should not create Requirements separate if we have Qualifications; but we could split Requirements and Qualifications? The posting has "Qualifications" section; we can treat that as Qualifications. No separate Requirements.
Thus output:
About the role
... (the paragraph about role)
Responsibilities
- Acquire data from primary or secondary data sources
- Identify, analyze, and interpret trends or patterns in complex data sets
- Transforming existing ETL logic on AWS Platform or Data Bricks
- Innovate new ways of managing, transforming and validating data
- Implement new or enhance services/scripts
- Establish and enforce guidelines to ensure consistency, quality and completeness of data assets
- Apply quality assurance best practices to all work products
- Analyze, design and code business-related solutions, as well as core architectural changes, using an Agile programming approach resulting in software delivered on time and in budget
- Experience of working in a development teams, using agile techniques and Object Oriented development and scripting languages, is preferred
- Comfortable learning cutting edge technologies and applications to greenfield project
Qualifications
- Advanced knowledge of application, data and infrastructure architecture disciplines
- 3+ years of Experience with Python is preferred
- 2+ years of Experience in Java Development
- 2+ Experience in a Big Data technologies (e.g. AWS, Spark, Kafka, Data Bricks etc.)
- Experience in writing efficient SQL's
- Experience in implementing complex ETL transformations on big data platform
- Strong Experience with UNIX shell scripting to automate file preparation and database loads
- Experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues
- Familiarity with relational database environment (Oracle, SQL Server, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy
- Strong development discipline and adherence to best practices and standards.
- Ability to manage multiple priorities and projects coupled with the flexibility to quickly adapt to ever-evolving business needs
- Demonstrated independent problem solving skills and ability to develop solutions to complex analytical/data-driven problems
- Must be able to communicate complex issues in a crisp and concise fashion to multiple levels of management
- Excellent interpersonal skills necessary to work effectively with colleagues at various levels of the organization and across multiple locations
- Experience in Data Science, Machine Learning and AI is a plus
- Financial Services and Commercial banking experience is a plus
- Familiarity with NoSQL platforms(MongoDB, AWS Open Search) is a plus
paragraphs: first about the role, second about the company (About Us). Ensure we don't repeat job title. Let's craft:
Commercial Banking IT is working on a strategic top priority initiative called Client 360 and working on building a CIB wide Marketing and Events Data Platform. We are looking for Big Data Software Engineer with skills and experience implementing platform to large-scale processing on internal as well as public cloud. This individual will work on groundbreaking work to implement new platform for Marketing and Events for Client 360 and also enhance the existing platforms. As a member of our Software Engineering Group we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation. JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
But note: The instruction says remove cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, and application instructions. The About Us paragraph includes EEO statements etc. That is boilerplate; we should remove that. The instruction: "Remove cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, and application instructions." So we must strip out EEO/equal-opportunity language. Also the part about "Visit our FAQs for more information about requesting an accommodation." and "JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans" is EEO boilerplate. So we should remove those sentences. We should keep the generic description about the firm, history, offerings, total rewards package, benefits list. That's not EEO. However the sentence "We are an equal opportunity employer..." is EEO; remove. Also "We do not discriminate..." remove. Also "We also make reasonable accommodations..." remove. Also "Visit our FAQs..." remove. Also "JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans" remove. Thus we need to edit the About Us paragraph to exclude those. Let's rewrite About Us paragraph without EEO: "JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's