Staff Software Engineer – Ozone/HDFS

Job title: Staff Software Engineer – Ozone/HDFS

Company: Cloudera

Job description: Business Area: EngineeringSeniority Level: Mid-Senior levelJob Description:At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we’re the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.Cloudera is looking for an exceptional and passionate software engineer with a distributed systems background to join the Storage Engineering team focused on building Apache Ozone. The Storage team is responsible for the primary storage and storage access layers which are core to the Cloudera Data Platform. Apache Ozone ( ) is an open source project purposed to build a massively scalable distributed object store. Ozone is designed to scale to thousands of nodes, tens of billions of objects and overcome the limitations of the Hadoop Distributed File System (HDFS).As a Staff Software Engineer, you will:You will be directly involved in the design and implementation of the core feature set of Apache Ozone and Apache Ratis (open-source RAFT implementation)You will regularly contribute code and design docs to the Apache open-source community.As part of storage engineering, you will support enterprise customers running 100s of petabytes-scale big data analytics and ML/AI pipelines.You will partner with product managers and cross-functional teams as a part of the Cloudera Data platform ecosystem in understanding requirements and turning them into a solid design and implementation, and facilitating integration and adoption.Additionally, in this role, you will be responsible for leading a talented group of engineers working on a feature and mentoring junior engineers.We’re excited about you if you have:BS or MS in Computer Science and 4- 6 years of experience.Strong backend engineering skill set with expertise in Java. Alternatively strong C++ skills with intermediate Java skills.Hands-on programmer with a good knowledge of data-structures and CS algorithms.Experience with large-scale, distributed systems design and development with a strong understanding of scaling, replication, consistency, and high availabilityExperience with system software design and development with an understanding of computer architecture, storage, network, and IO subsystemsClean coding habits, attention to detail, and focus on qualityGood oral and written communicationYou may also have:Strong background in a distributed storage system, including file systems, database storage internals, NoSQL storage, or distributed hash tablesStrong background in performance tuning, identifying performance bottlenecks, and implementing performance optimizationsStrong understanding of the Apache Big Data ecosystem and over 3+ years of experience in systems software, including file systemsRecognized contributions to open source projectsExperience using projects such as Hive, Pig, MapReduce, HBase, etc., is a big plusGood Understanding of storage development, RAFT replication framework, or equivalent distributed consensus frameworksWhat you can expect from us:Generous PTO PolicySupport work life balance withFlexible WFH PolicyMental & Physical Wellness programsPhone and Internet Reimbursement programAccess to Continued Career DevelopmentComprehensive Benefits and Competitive PackagesEmployee Resource GroupsCloudera is an Equal Opportunity / Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.# LI-SZ1
#LI-Remote

Expected salary:

Location: British Columbia

Job date: Fri, 23 May 2025 06:50:55 GMT

Apply for the job now!