Big data, Verizon Media

Verizon Media

At Verizon Media, we connect people to their passions. With brands like Yahoo, TechCrunch and more, we help people stay informed and entertained, communicate and transact while creating new ways for advertisers and partners to connect. From XR experiences to advertising and content technology, Verizon Media is an incubator of innovation and is revolutionizing the next generation of content creation in a 5G world.

 

Big Data Platform

 

We build some of the largest data lakes in the world!

We manage 50K nodes

We run 1.5 million jobs per day across thousands of users and application processing close to an exabyte of data

Developing dozens of big data components including Presto, HBase, Hive, Pig, Oozie, and more

We do coolest projects!

Building brand new caching layer from scratch for Presto!

Building brand new stats collection layer utilizing sketches for data compression for Hive, Presto, and Spark

Building state of the art rolling upgrade system for HBase

Designing scalable and performant OLTP layer for HBase that can compete with Oracle!

We do open source!

We are active in 6 Apache projects for Hive, Pig, Oozie, Presto and HBase, and Tez with 6 committers and PMC members in the team of 10.

We participate in most major Big Data conferences including Hadoop Summit/DataWorks, Strata, HBaseCon, Spark Summit, Presto Summit and more.

We have one of the best work environments where you can

Have huge impact: we are agile with at least monthly release for each product. We work like a startup with all the benefits of large company;

be challenged: we solve some of the most complex problems in the industry;

Be known: open source makes you known and famous at the scale way beyond your immediate team;

Have great mentors. Work with experts across big data technology stack. Work with nice people with get things done attitude.

Have free food all day long :).

JOB POST

 

Big Data Systems Engineer – Open Source Development

 

About The Team

 

We’re looking for engineers to join the Verizon Media Big Data team. In this role, you’d be building some of the largest data lakes in the world! We manage 50K nodes running 1.5 million jobs per day, across thousands of users and application, processing close to an exabyte of data.

 

So when considering this position, please ask yourself, do you want to do something exceptional?

 

About The Role

 

The qualified engineer would work on one or more of the following open source projects: Pig, Oozie, Hive, PrestoDB or Hbase. On this outstanding team, we’re challenged by complex problems day in and day out, and in having each other to lean on, we find ourselves growing every day as a result.

 

We’re currently active in 6 Apache projects and our team consists of numerous committers and PMC members. In other words, not only will you make a massive impact here at Verizon Media, but globally as well.

 

We work like a startup, do phenomenal work, and have fun while we do it. Come join us and become an authority on big data and cloud computing!

 

Did I mention free food? Yeah, we have that too.

 

Responsibilities

Understand all aspects of our distributed systems and learn select components in detail

Be a leader in open source (Apache Software Foundation) projects

Design massively distributed technology and develop bleeding-edge cloud computing software

Work closely with service engineering, operations, and Hadoop users to engineer bleeding-edge solutions that allow us to answer today’s most meaningful data-related questions

Current Projects

Develop brand new caching layer from scratch for Presto

Build a brand new stats collection layer utilizing sketches for data compression for Hive, Presto, and Spark

Work on state of the art rolling upgrade system for HBase

Crafting scalable and performant OLTP layer for HBase that can compete with Oracle!

Qualifications

BS/MS in Computer Science (or equivalent)

Strong work history and/or educational background

Skilled in either Java or C++

In-depth knowledge of Algorithms, Data Structures, and Performance Optimization Techniques

A passion for working with large distributed data and systems

An interest in working on database internals and query optimization

 

Verizon Media is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Verizon Media is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( https://www.verizonmedia.com/careers/contact-us.html ) or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

 

At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion ( https://www.verizon.com/about/careers/work-culture ) page to learn more

For example: I am very interested in the position at [company]. I believe my skills and work experience make me an ideal candidate for this role. I look forward to speaking with you soon about this position.
Upload your CV/resume or any other relevant file. Max. file size: 2 MB.


You can apply to this job and others using your online resume. Click the link below to submit your online resume and email your application to this employer.