Senior Data Engineer ID86297
AgileEngine
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for an experienced Senior Data Engineer to help modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers. This role also uses AI tools like Claude and GitHub Copilot to speed up development.
WHAT YOU WILL DO
- Design, build, and operate batch and streaming data pipelines on Databricks using PySpark, Delta Lake, and Databricks Workflows.
- Model and maintain a medallion (bronze/silver/gold) architecture serving analytics, reporting, and machine learning consumers.
- Migrate legacy ETL and data warehouse workloads onto the Lakehouse with validated data parity and minimal business disruption.
- Use Claude or Github Copilot as a development accelerator, generating code scaffolding, writing and reviewing tests, creating documentation and prototyping solutions.
- Write clean, well-tested Python and SQL; maintain high standards through code review and documentation.
- Optimize Spark jobs and Delta tables for performance and cost, including partitioning, clustering, caching, and cluster sizing.
- Implement data quality, lineage, and governance controls using Unity Catalog and automated validation checks.
- Debug, troubleshoot, and resolve pipeline failures, data defects, and production incidents.
- Participate in Agile or product-centric delivery practices including sprint planning and retrospectives.
- Collaborate with DevOps, platform, and analytics engineers on observability, security, and compliance best practices.
MUST HAVES
- 4+ years of professional experience in data engineering , featuring direct expertise with Apache Spark and cloud-based data architectures.
- Strong hands-on experience building data pipelines with Databricks, Apache Spark (PySpark), and Delta Lake .
- Advanced SQL and Python , with strong data modeling skills across dimensional and Lakehouse patterns.
- Experience with streaming ingestion using Structured Streaming, Auto Loader, Kafka, or Event Hubs .
- Experience with workflow orchestration ( Databricks Workflows, Airflow, or Azure Data Factory ).
- Experience with legacy platform migrations, ETL modernization, or managing data hygiene when porting old systems.
- Strong problem-solving, collaboration, and communication skills, including mentoring junior engineers and explaining data concepts to non-technical stakeholders.
- Familiarity with Unity Catalog , data governance, access control, and PII handling.
- Experience with dbt or an equivalent transformation framework.
- Familiarity with secure coding standards and industry security best practices.
- Experience delivering production data platforms at scale.
- Upper-intermediate English level.
NICE TO HAVES
- Experience with Infrastructure as Code (IaC) using Terraform and CI/CD using Azure Devops.
- Experience working with relational databases (specifically PostgreSQL) and data persistence concepts.
- Familiarity with logging and monitoring tools (e.g., Dynatrace, CloudWatch, Databricks system tables).
- Experience working in Agile or team-based development environments preferred.
PERKS AND BENEFITS
- Growth without limits : build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
- Competitive compensation : get recognition that reflects your skills and impact, with regular performance and compensation reviews
- Flexibility : work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
- Meaningful, modern projects : build impactful products using modern technologies alongside global teams and leading brands
- Collaborative culture : join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
- Well-being & support : access local well-being programs and people-focused support tailored to your location
- ...Por encargo de nuestro cliente líder del sector financiero, nos encontramos de la búsqueda de un Analista Senior de Ciberdefensa (Vulnerabilidades), donde participarás en un proyecto de soluciones para el segmento empresarial, especialmente funcionalidades financieras...SeniorTiempo completo
- ...like oil and gas, manufacturing, CPG, and materials. About the Role We're looking for an Executive Assistant to support two senior executives at the firm. This is a high-trust, high-ownership role. You'll manage complex calendars, own inbox triage and follow-up,...SeniorTiempo completoContratoRemotoTrabajo por turnos
- ...scale our core UI kit, design tokens, component libraries, and visual guidelines from scratch to ensure speed and consistency as engineering builds. Developer-Ready Handoffs: Work hand-in-hand with our Frontend Engineers (React/Vue). Deliver clean SVG assets, responsive...SeniorPrácticaFreelanceTiempo completoTrabajo híbrido1 día a la semana
$ 770,000
...The successful candidate will lead the HR team and oversee the continuous improvement of key people processes, working closely with senior management, operational teams and support functions. The role will focus on strengthening HR as a strategic partner, providing...SeniorEmpleo permanenteContratoTrabajo híbrido- ...grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Middle Data Engineer to help modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming...SugeridoTiempo completoRemotoHorario flexible
- ...grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Quality Engineer to drive quality throughout the software development lifecycle by partnering with Product Managers, Software Engineers, and...SeniorPrácticaTiempo completoRemotoHorario flexibleTrabajo por turnos
- ...love to meet you! ABOUT THE ROLE We are looking for a Senior Data Scientist to drive rigorous statistical execution, multi-... ...flaws before deployment. - Collaborate daily with internal engineering cross-functions via Slack and Google Meet to rapidly resolve...SeniorTiempo completoRemotoInicio inmediatoHorario flexible
- ...closure. • Act as a strategic partner to senior leadership, ensuring timely resolution of... ..., and provide feedback. • Conduct data analysis to identify trends, systemic... ...administration, Finance, Risk Management, Accounting, Engineering, Technology or a related field. • An...SeniorTrabajar en la oficinaTrabajo híbrido
- Objetivo del Rol Apoyar la ejecución operativa de las actividades relacionadas con la migración y apagado de DataMarts, contribuyendo a reducir la carga operativa del equipo técnico y asegurando la correcta ejecución, validación y continuidad de los procesos de datos...AprendizRemotoTrabajo híbridoHorario flexible
- ...aftersales services, financing solutions, and comprehensive customer support. About the role We are looking for a Senior Software Engineer with strong full-stack expertise and a passion for building high-quality, scalable systems. This role is ideal for an experienced...SeniorRemoto
- ...Management, Business Operations, or a comparable role. ~ Demonstrated experience supporting a founder, executive, entrepreneur, or senior leader. ~ Strong project and task management capabilities. ~ Experience coordinating remote teams or contractors. ~...SeniorTiempo parcialTiempo completoContratistaTrabajar en la oficinaRemoto
- ⭐ Senior FP&A Business Analyst (SAP Analytics Cloud Planning) – Advanced English – 100% Remote Location: Remote Work Mode: 100... ...&A planning and forecasting processes, planning operations, and data governance activities within a global environment. The ideal...SeniorFreelanceTiempo completoContratoRemoto
- ...crecimiento. TU MISIÓN Serás responsable de impulsar la adquisición digital de la marca, tomando decisiones sobre: PAUTA + DATA + CREATIVIDAD + E-COMMERCE + GROWTH Trabajarás principalmente en: Meta Ads & Google Ads. Estrategias de adquisición,...SeniorIndefinidoAutónomoContratoRemotoLunes a viernes
$ 12,500,000
️ ¡Buscamos Líder de Obra Senior! | Metro de Bogotá Una importante constructora e inmobiliaria busca incorporar a su equipo 2 profesionales senior para liderar proyectos de gran escala y alto impacto en Bogotá. Si cuentas con una trayectoria sólida en construcción...SeniorIndefinidoTrabajar en la oficinaLunes a viernes- ⚡ Ingeniero(a) Senior de Diseño de Transformadores | Funza ¿Eres Ingeniero(a) Eléctrico, Electricista, Electromecánico o afín y cuentas con experiencia en diseño y/o especificación de transformadores eléctricos ? ¡Esta oportunidad es para ti! Nos encontramos en la...SeniorContratoLunes a viernes
$2,848,000 - 2,948,000
Hello! We are conducting a customer service campaign for a premium delivery service in the U.S. that operates through robots. The focus will be on resolving issues related to customer orders. Interactions will take place through chat, phone calls, and emails. This...SeniorEmpleo permanenteContratoDesde casaTrabajo por turnos$ 5,500,000
...Buscamos Ingeniero de Datos Senior para diseñar, desarrollar y optimizar pipelines de datos a gran escala, tanto en procesos batch como streaming , dentro de una célula ágil orientada a datos. Requisitos indispensables Apache Spark avanzado: dominio de PySpark...SeniorPrácticaContratoRemotoInicio inmediatoLunes a viernes- Descripción de la empresa SGS is the world’s leading inspection, verification, testing and certification company. SGS is recognised as the global benchmark for quality and integrity. We support governments, government agencies and the private sector on trade facilitation...SeniorIndefinidoTiempo completoTrabajar en la oficinaLunes a viernes
- ...Job Description About You You are a Data Quality Assurance Engineer who enjoys ensuring the accuracy, completeness, and reliability of data across complex data environments. You have hands-on experience validating high-volume datasets, testing ETL processes,...TemporalTiempo completoContratista
- ...amplio de personas. Una vez que estés a bordo, fomentamos y promovemos a individuos talentosos, asegurándonos de que las posiciones senior estén abiertas a todos. Descubre el Rol Haz parte de nuestro equipo y potencia tu carrera. Buscamos un Asistente de...SeniorAprendizTrabajar en la oficinaDesde casa
- ACIPROYECTOS S.A. busca Inspector SISOMA: Ingeniero Ambiental o Ingeniero Industrial, o profesional en seguridad y salud en el trabajo, con licencia vigente de SST, para laborar en Cúcuta, 100% presencial. Se requiere 6 años de experiencia desde la tarjeta profesional...Senior
ACI PROYECTOS S.A.
Bogotá, D.C.17 horas atrás - ...CONFIDENTIAL, una compañía del sector alimentario, busca un Analista Senior de Investigación y Desarrollo apasionado por la innovación para participar en la creación, optimización y lanzamiento de nuevas soluciones para nuestras categorías de negocio. Será responsable...Senior
CONFIDENTIAL
Bogotá, D.C.17 horas atrás - ...Buscamos un Ingeniero de Inteligencia Artificial (AI Engineer) con mentalidad AI-first, apasionado por las nuevas tecnologías y con capacidad para aprender, experimentar e implementar rápidamente soluciones basadas en Inteligencia Artificial. Este rol está orientado...AprendizPrácticaEmpleo permanente
CONFIDENTIAL
Bogotá, D.C.17 horas atrás - SONDA busca un Especialista de Ciberseguridad para implementar y mantener el SGSI, desarrollar políticas de seguridad y asegurar el cumplimiento normativo en la organización. Se espera experiencia en gestión de riesgos, incidentes y auditorías, con capacidad de coordinar...SeniorRemotoTrabajo híbrido
SONDA
Bogotá, D.C.17 horas atrás - ...Importante compañía del sector se encuentra en la búsqueda de un Analista Senior de Investigación y Desarrollo apasionado(a) por la innovación y el desarrollo de productos alimenticios, que participe activamente en la creación, optimización y lanzamiento de nuevas soluciones...SeniorContratoTrabajar en la oficinaLunes a viernes
CONFIDENTIAL
Bogotá, D.C.17 horas atrás - ...regards to resolution. Escalate all high priority issues affecting availability, customer impact and user impact to the Manager, and Senior Management. Raise Service Now tickets from any email or phone issue request and assign them to the suitable support team....SeniorTrabajar en la oficina
Scotiabank
Bogotá, D.C.17 horas atrás - CONFIDENTIAL, ubicado en Bogotá, busca un Administrador de Microsoft para unirse al equipo de IT. Se valorará experiencia sólida gestionando Windows Server 2012 o superior y certificaciones MCP. Se requiere mínimo 5 años de experiencia profesional en administración ...Senior
CONFIDENTIAL
Bogotá, D.C.17 horas atrás $ 3,644,500
.... Aquí, una mejor vida empieza cuando tu trabajo ayuda a cuidar la vida. En La Santé y Pharmetique Labs buscamos un(a) Analista Senior de Aseguramiento de Calidad para apoyar procesos críticos de manufactura e inspecciones BPM. Tu reto Harás seguimiento a los...SeniorAprendizPrácticaTemporalLaboratorios La Santé S.A.
Bogotá, D.C.17 horas atrás- ...Laboratorios La Santé S.A. busca un Analista Senior de Aseguramiento de Calidad para apoyar procesos críticos de manufactura e inspecciones BPM en su planta de Bogotá. El rol implica revisar muestras de retención y participar en la aprobación de productos, asegurando...SeniorAprendizTemporal
Laboratorios La Santé S.A.
Bogotá, D.C.17 horas atrás - Compañía de Servicios, dedicada a Ingeniería y diseño, Gestión de Proyectos y Energías Renovables, busca profesional con experiencia en proyectos complejos y certificación PMP. Se valora experiencia en Oil & Gas y manejo de herramientas colaborativas como Planner (Office...SeniorTrabajar en la oficina
CONFIDENTIAL
Bogotá, D.C.17 horas atrás
¿Desea recibir más vacantes?
Suscríbase y reciba vacantes similares a Senior Data Engineer ID86297. ¡Sea el primero en aplicar!
- tecnico mecanico senior Bogotá, D.C.
- analista senior de facturacion Bogotá, D.C.
- ingeniero civil senior Bogotá, D.C.
- comprador senior Bogotá, D.C.
- senior graphic designer job remote Bogotá, D.C.
- residente senior Bogotá, D.C.
- senior de auditoria kpmg Bogotá, D.C.
- analista de nomina senior Bogotá, D.C.
- auditor senior Bogotá, D.C.
- analista senior de reclutamiento y seleccion Bogotá, D.C.