Job Requirements
At Quest Global, it’s not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.
Key Responsibilities
-
Design, build, and maintain scalable, reliable data pipelines for efficient data collection, transformation, and storage, aligned with business needs and industry best practices.
-
Ensure data quality and integrity through robust validation and cleaning processes.
-
Optimize data storage and retrieval for efficient access and analysis by data scientists and analysts.
-
Work with both Batch and Streaming data and create robust ETL pipelines.
-
Develop and maintain data warehouses and data lakes for centralized and organized data access.
-
Implement data security measures to protect sensitive information and ensure compliance with privacy regulations.
-
Continuously monitor and optimize system performance for reliability and scalability.
-
Data Preparation: Clean, transform, and prepare raw data for analysis, ensuring accuracy, completeness, and readiness for modeling.
-
Data Integration: Integrate data from diverse sources, creating a unified and comprehensive organizational data view.
-
Data Quality: Continuously assess and improve data quality, reliability, and consistency to ensure trustworthy data for analysis.
-
Data Acquisition: Identify, evaluate, and integrate new data sources to enhance data infrastructure.
-
Analytical Tools Development: Design and develop tools and programs to streamline data processing, analysis, and reporting.
-
Collaboration: Partner with and lead other engineers and architects, providing technical expertise and ensuring seamless integration between data infrastructure and analytical tools
We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.
We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.
Work Experience
- Proficiency in SQL and database management: Strong SQL skills to manipulate and query data stored in relational databases, as well as to design and optimize database schemas.
-
Knowledge of Hadoop, Spark, or other big data frameworks: Familiarity with big data processing frameworks like Hadoop and Spark is essential for managing and processing large datasets efficiently.
-
Familiarity with data warehousing solutions: Understanding data warehousing concepts and experience with platforms like Amazon Redshift, Google BigQuery, or Snowflake is important for designing and managing data storage solutions.
-
Familiarity with streaming solutions like Apache Flink and Kafka.
-
Experience with data pipeline and workflow management tools: Proficient in tools like Apache Airflow, or similar, to orchestrate data pipelines, automate workflows, and ensure data integration and transformation tasks are executed reliably.
-
Hands-on experience with major cloud platforms like Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) is highly preferred
-
Knowledge of cloud-specific tools and services for data storage, processing, and analysis can demonstrate your ability to leverage the cloud’s scalability and flexibility.
-
Strong problem-solving, effective communication, and attention to detail are crucial.
-
The ability to analyze issues, identify root causes, and develop effective solutions.
