BigData DevOps Engineer

Experian · Costa Rica ·

AI Application Agent

Match Analysis & CV

Click Generate All to analyze match and tailor your CV.

Cover Letter

Click Generate All or Cover Letter to start.

Application Email

Click Generate All or Email to draft.

Job Description
<h2>Company Description</h2> <p>Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries</p> <h2>Job Description</h2> <p>As an important aide to both the IT Infrastructure and Development teams, you will help support existing systems 24x7 and responsible for administering current Big Data environments. You will manage BigData Group environments and will work with teammates to maintain working solutions for our big data tech stack. To support product development following the product roadmap for product maintenance and enhancement such that the quality of software deliverables maintains excellent customer relationships and increases the customer base. You will report to the Engineering Manager, Data Platforms.</p> <p>If you have the skills and we would love to talk to you!</p> <p>What you'll do:</p> <ul> <li>Implement, support, and administer Hadoop and AWS EMR environments.</li> <li>Maintain Terraform and IaC for provisioning and managing AWS resources.</li> <li>Provide CI/CD solutions.</li> <li>Automate deployment and operations of Big Data technologies using DevOps tools.</li> <li>Onboard Hadoop users and manage Kerberos, HDFS, Hive, HBase, and Yarn access.</li> <li>Implement security best practices across HBase, HDFS, Kafka, Hive, and related components.</li> <li>Tune Hadoop clusters, MapReduce, Spark workloads, and optimize EMR for performance and cost.</li> <li>Monitor group health, logs, storage, and perform proactive capacity management.</li> <li>Collaborate with infrastructure, network, DB, application, and BI teams to ensure platform reliability.</li> <li>Support upgrades and patching for EMR, HBase, Spark, and other data platforms