Verizon Media
At Verizon Media, we connect people to their passions. With brands like Yahoo, TechCrunch and more, we help people stay informed and entertained, communicate and transact while creating new ways for advertisers and partners to connect. From XR experiences to advertising and content technology, Verizon Media is an incubator of innovation and is revolutionizing the next generation of content creation in a 5G world.
Big Data Platform
We build some of the largest data lakes in the world!
We manage 50K nodes
We run 1.5 million jobs per day across thousands of users and application processing close to an exabyte of data
Developing dozens of big data components including Presto, HBase, Hive, Pig, Oozie, and more
We do coolest projects!
Building brand new caching layer from scratch for Presto!
Building brand new stats collection layer utilizing sketches for data compression for Hive, Presto, and Spark
Building state of the art rolling upgrade system for HBase
Designing scalable and performant OLTP layer for HBase that can compete with Oracle!
We do open source!
We are active in 6 Apache projects for Hive, Pig, Oozie, Presto and HBase, and Tez with 6 committers and PMC members in the team of 10.
We participate in most major Big Data conferences including Hadoop Summit/DataWorks, Strata, HBaseCon, Spark Summit, Presto Summit and more.
We have one of the best work environments where you can
Have huge impact: we are agile with at least monthly release for each product. We work like a startup with all the benefits of large company;
be challenged: we solve some of the most complex problems in the industry;
Be known: open source makes you known and famous at the scale way beyond your immediate team;
Have great mentors. Work with experts across big data technology stack. Work with nice people with get things done attitude.
Have free food all day long :).
JOB POST
Big Data Systems Engineer – Open Source Development
About The Team
We’re looking for engineers to join the Verizon Media Big Data team. In this role, you’d be building some of the largest data lakes in the world! We manage 50K nodes running 1.5 million jobs per day, across thousands of users and application, processing close to an exabyte of data.
So when considering this position, please ask yourself, do you want to do something exceptional?
About The Role
The qualified engineer would work on one or more of the following open source projects: Pig, Oozie, Hive, PrestoDB or Hbase. On this outstanding team, we’re challenged by complex problems day in and day out, and in having each other to lean on, we find ourselves growing every day as a result.
We’re currently active in 6 Apache projects and our team consists of numerous committers and PMC members. In other words, not only will you make a massive impact here at Verizon Media, but globally as well.
We work like a startup, do phenomenal work, and have fun while we do it. Come join us and become an authority on big data and cloud computing!
Did I mention free food? Yeah, we have that too.
Responsibilities
Understand all aspects of our distributed systems and learn select components in detail
Be a leader in open source (Apache Software Foundation) projects
Design massively distributed technology and develop bleeding-edge cloud computing software
Work closely with service engineering, operations, and Hadoop users to engineer bleeding-edge solutions that allow us to answer today’s most meaningful data-related questions
Current Projects
Develop brand new caching layer from scratch for Presto
Build a brand new stats collection layer utilizing sketches for data compression for Hive, Presto, and Spark
Work on state of the art rolling upgrade system for HBase
Crafting scalable and performant OLTP layer for HBase that can compete with Oracle!
Qualifications
BS/MS in Computer Science (or equivalent)
Strong work history and/or educational background
Skilled in either Java or C++
In-depth knowledge of Algorithms, Data Structures, and Performance Optimization Techniques
A passion for working with large distributed data and systems
An interest in working on database internals and query optimization
Verizon Media is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Verizon Media is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( https://www.verizonmedia.com/careers/contact-us.html ) or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.
At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion ( https://www.verizon.com/about/careers/work-culture ) page to learn more
