Airbnb was born in 2007 when two Hosts welcomed three guests to their San Francisco home, and has since grown to over 4 million Hosts who have welcomed more than 1 billion guest arrivals in almost every country across the globe. Every day, Hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.
The Community You Will Join:
The Global Markets engineering team is focusing on evolving our guest and host experience for global markets through new product initiatives to accelerate international growth.
Expanding in under-penetrated global markets is a key pillar of our company’s growth strategy. To achieve this, we want to innovate in every sense of the world and adapt our product to every corner of the globe. We want every user in each of our 220+ countries and regions to feel right at home.
The Difference You Will Make:
Data Engineers at Airbnb are responsible for ensuring the company has trustworthy data for innovation & operations. They play a unique role of bridging the gap and connecting data producers (typically Software Engineers who own the online source systems) to data consumers (typically Analysts, Data Scientists and Software Engineers building applications which rely on the data).
The role of a Data Engineer is critical to the success of any data driven organization. Data Engineers deliver business value by increasing both confidence in the integrity of decision making and productivity of data consumers across the company.
A Typical Day:
- Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.
- Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
- Ensure the quality, performance, and stability of data systems with thoughtful quality systems and monitoring
- Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions
- Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues.
- Strong architectural knowledge, comfort working across multiple repositories, services, and environments.
Your Expertise:
- 3+ years of relevant industry experience
- Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)
- Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
- Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
- Expert in at least one programming language for data analysis (e.g. Python, R)
- Excellent written and verbal communication skills
Your Location
This position is China - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. Your recruiter will inform you what cities you are able to work from depending on your personal legal working identity and Airbnb internal policies.
Our Commitment to Inclusion & Belonging:
Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply.