Atlassian is looking for a Principal Data Engineer to join our Data Engineering Team. We are looking for an open-minded, structured thinker who is passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights and play an active role in building Atlassian's data-driven culture.
As a Principal Data Engineer, you will have the opportunity to apply your strong technical expertise to build analytics data models and support a broad range of analytical requirements across the company. You will be very well-rounded and have a broad understanding of the data architecture and platforms. You will coordinate the technical approach towards the goal and ensure that technical risks and unknowns are addressed, ensuring the successful and timely delivery of projects. You will achieve the impact by amplifying the performance of those around you and through de-risking the work that you lead.
Own the technical evolution of the data engineering capabilities and be responsible for ensuring solutions are being delivered incrementally, meeting their outcomes and promptly escalating risks and issuesEstablish deep understanding of how things work in data engineering, use this to direct and coordinate the technical aspects of work across the data engineering and systematically improve productivity across the data engineeringResponsible for the operational quality and proactively addressing performance, scale, complexity and security considerations.Drive complex decisions that can impact the work in data engineering. Set the technical direction and balance customer and business needs with long-term maintainabilityDefine the problem space and reduce ambiguity. Coordinate a team of engineers towards implementing them, unblocking them along the way if necessary.Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager and provide consistent feedback to help them manage and grow the teamProvide deep technical guidance in a number of aspects of data engineering in a scalable ecosystemWork with close counterparts in other departments as part of a multi-functional team, and build this culture in your team
On your first day, we'll expect you to have
10+ years experience in a Data Engineer role as an individual contributor7+ years of experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)5+ years of experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools.5+ years of experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka).Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a "Streaming First" mindset to lead Atlassian's business growth and improve the product experience.Worked closely Data Science teams or analytics teams with deep understanding of data challenges at scale challenges and the eco-systemGreat communication skill and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success.Experience with at least one high-level programming language, preferably Python
We'd be super excited if you have
Designed and implemented OLAP (Online Analytical Processing) to power real-time analytics.Built real-time data processing pipelines using Apache Spark Streaming/ Databricks and is well-versed with their APIs.Develop and implement data governance procedures to ensure data security, privacy, and compliance.Above all else, as a Principal Data Engineer, you will lead large programs, driving architectural decisions, and incorporating business and technology strategies. You will mentor junior members of the team and help onboard and grow the team.