Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR)
Amazon Web Services•Published 1 days ago•First seen 19 hours ago
Want to change the world with Big Data and Analytics? Come join us on the Amazon EMR team in Amazon Web Services!
Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Apache Hadoop, Spark, Hive, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run large number of customer clusters, enabling a variety of customer use cases including analytics and web-scale machine learning.
We are developing innovative new features including our next-generation cluster management system, improvements for real-time processing of big data, and ways to enable customers to more easily interact with their data. We’re looking for top engineers to build them from the ground up.
Key job responsibilities
You will work backwards from the customer needs and you will get to do everything from designing and building large scale systems and features for the savviest customers in the business. You will have a chance to work with the open source community and contribute significant portions its software to open source projects including Hadoop, Spark, Hive, Presto and HBase. You need to not only be a top software developer with excellent programming skills, an understanding of distributed systems and parallel data processing, and a stellar record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group. Your responsibilities will include:
1. Designing and building the next-generation technologies that will make EMR the best environment to run large-scale data processing workloads.
2. Working on complex problems in distributed systems and query engines.
3. Translation of complex functional and technical requirements into detailed architecture and design.
4. Deliver systems and features with top-notch quality, on time.
5. Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.
About the team
By joining our team, you will get to work with a minimum of technical supervision, while playing a variety of roles as needed to respond efficiently to multiple program priorities. You will get to collaborate with some of the best and brightest minds in the industry. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect!
For more information:
AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/
AWS EMR: https://aws.amazon.com/emr/
About AWS
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness.
Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
USA, WA, Redmond - 143,700.00 - 194,400.00 USD annually
Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Apache Hadoop, Spark, Hive, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run large number of customer clusters, enabling a variety of customer use cases including analytics and web-scale machine learning.
We are developing innovative new features including our next-generation cluster management system, improvements for real-time processing of big data, and ways to enable customers to more easily interact with their data. We’re looking for top engineers to build them from the ground up.
Key job responsibilities
You will work backwards from the customer needs and you will get to do everything from designing and building large scale systems and features for the savviest customers in the business. You will have a chance to work with the open source community and contribute significant portions its software to open source projects including Hadoop, Spark, Hive, Presto and HBase. You need to not only be a top software developer with excellent programming skills, an understanding of distributed systems and parallel data processing, and a stellar record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group. Your responsibilities will include:
1. Designing and building the next-generation technologies that will make EMR the best environment to run large-scale data processing workloads.
2. Working on complex problems in distributed systems and query engines.
3. Translation of complex functional and technical requirements into detailed architecture and design.
4. Deliver systems and features with top-notch quality, on time.
5. Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.
About the team
By joining our team, you will get to work with a minimum of technical supervision, while playing a variety of roles as needed to respond efficiently to multiple program priorities. You will get to collaborate with some of the best and brightest minds in the industry. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect!
For more information:
AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/
AWS EMR: https://aws.amazon.com/emr/
About AWS
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness.
Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Basic Qualifications
- 2+ years of non-internship professional software development experience
- Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design
- 1+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience
Preferred Qualifications
- Experience designing, building, operating, and managing large-scale distributed systems or web services
- Proficiency in high-performance, multi-threaded programming
- Knowledge of Big Data application such as Spark and Presto
- Knowledge of Container Platforms such as Docker and related technologies
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Redmond - 143,700.00 - 194,400.00 USD annually