Senior Data Engineer

See more jobs from Welocalize

about 1 year old

Apply Now

Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:

ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.

Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.

A Staff Data Engineer/Architect is responsible for designing, implementing, and maintaining an organization's databases, data warehousing systems, and data processing architectures. They play a crucial role in managing and safeguarding the company's data, developing strategies for data acquisitions, and optimizing data retrieval, ensuring all data systems meet company and client needs.

Tasks and Responsibilities

  • A Staff Data Engineer/Architect meticulously designs, constructs, and manages large-scale, robust data architectures. They are responsible for overseeing the development of comprehensive databases, data lakes, and data warehouses.
  • They frequently evaluate and enhance the performance of data management systems, ensuring they meet both technical and business requirements.
  • With a strategic approach, they consistently develop and implement data governance policies and procedures to ensure the integrity, confidentiality, and availability of enterprise data.
  • They are regularly in coordination with cross-functional teams, such as software developers, data scientists, and IT staff, to ensure data solutions are optimized and aligned with company goals.
  • They efficiently liaise with globally based business teams and local project management teams to understand their data needs and provide suitable solutions.
  • A Staff Data Engineer/Architect is accountable for leading the data architecture vision and strategy for the organization, often presenting to stakeholders and executive teams.
  • They frequently review existing systems and processes, identifying areas for improvement and implementing changes in a timely and effective manner.
  • They actively stay abreast of the latest industry developments, technologies, and best practices in data management, participating in professional development opportunities as needed.
  • A Staff Data Engineer/Architect operates with a high degree of independence but also collaborates extensively with various teams and stakeholders within the organization to ensure the effectiveness of data systems and strategies.
  • They are responsible for mentoring and guiding junior data engineers and other technical staff, promoting a culture of continuous learning and improvement within the team.
  • Skills and Knowledge

  • Data Architecture Skills: Proficiency in designing, implementing, and maintaining scalable and robust data architectures. This includes understanding of data warehousing, data lakes, and databases.
  • Understanding Architecture Tradeoffs: Ability to evaluate and articulate the tradeoffs of different architectural solutions. This includes considerations of cost, performance, scalability, reliability, and security.
  • Machine Learning Pipelining: Expertise in designing and implementing data pipelines for Machine Learning. This involves understanding of data extraction, transformation, and loading (ETL) processes, as well as feature engineering and model deployment. Understanding of how data quality impacts the performance of these algorithms.
  • Data Modeling and Design: Expertise in logical and physical data modeling, with the ability to design optimized data structures for Machine Learning applications.
  • Technical Skills: Proficiency in tools and technologies used for managing big data (like Hadoop, Spark) and developing Machine Learning models (like Python, R, TensorFlow).
  • Analytical and Problem-Solving Skills: Ability to analyze complex data, identify patterns, and solve problems. This includes troubleshooting issues in data pipelines and optimizing them for better performance.
  • Communication Skills: Ability to clearly articulate complex data architecture concepts and tradeoffs to both technical and non-technical stakeholders.
  • Project Management Skills: Ability to manage and prioritize multiple projects, often with tight deadlines.
  • Continuous Learning: Keeping up-to-date with the latest trends and advancements in data architecture and Machine Learning, and applying this knowledge to improve existing systems and processes.
  • Experience

  • Minimum 8 years as a Senior data engineer or higher in a professional environment.
  • Bonus: prior decision-making and leadership of large-scale architecture modernization, working with stakeholders across org.