Visa is hiring a Senior Data Engineer (listed as Analyst level in the description) for its Data Lake team in Brazil to build and maintain data ingestion and transformation pipelines using Spark, Databricks, and Airflow.
Not stated“At Pismo, the Data Lake team is responsible for centralizing and organizing data into a single, trusted platform that supports decision-making across the company and for external clients.”
Product areasData Lake · Data Ingestion and Transformation Pipelines · Corporate Data Platform
GoalsCentralizing and organizing data into a single, trusted platform · Supporting decision-making across the company and for external clients · Scaling global data infrastructure · Delivering high-quality reporting · Enabling secure, self-service access to data · Avoiding information silos
MarketsBrazil
TechApache Spark · PySpark · SparkSQL · Databricks · Apache Airflow · MWAA · SQL · Amazon S3 · AWS · Delta Lake · Great Expectations · Python · Git/GitHub · Terraform · Superset