Job description

Minimum Years exp 13 or Above

Key things Python, spark, AWS,Pyspark

1 client coding interview

Responsibilities

· Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.

· Collaborate with product and technology teams to design and validate the capabilities of the data platform

· Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability

· Provide technical support and usage guidance to the users of our platform’s services.

· Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications

· Experience building and optimizing data pipelines in a distributed environment

· Experience supporting and working with cross-functional teams

· Proficiency working in Linux environment

· 4+ years of advanced working knowledge of SQL, Python, and PySpark

· 2+ years of experience with using a broad range of AWS technologies

· Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

· Experience with platform monitoring and alerts tools

Job Types: Full-time, Contract

Pay: From $75.00 per hour

Experience level:

• 11+ years

Schedule:

• 8 hour shift

Work Location: Remote

blackflymedia.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, blackflymedia.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, blackflymedia.com is the ideal place to find your next job.