Must Have:
- Programming Languages: Python
· Development Tools: LangChain, LlamaIndex, LangFlow, Langgraph, LangSmith, Flowise
· Techniques: RAG Techniques
· Databases: Vector Databases (Pinecone, Weaviate, Qdrant)
· Additional Technologies: Knowledge Graphs, FastAPI, Streamlit, Gradio
· Languages & Libraries: Python, Data Engineering, OSS LLMs (Llama2, Mixtral, GPT-Neo, GPT-J)
· Tokenization & Frameworks: Tokenizers (SentencePiece, Hugging Face Tokenizers), Fine-tuning Frameworks (Hugging Face Transformers, PyTorch Lightning)
· Datasets: HuggingFace Datasets, TensorFlow Datasets
· Infrastructure & CI/CD: DevOps, Kubernetes, Docker, Git, Jenkins, GitLab, GitHub Actions
· Monitoring & Management: Ray, SeldonCore, MLFlow, MLServer, Triton, BentoML, Prometheus, Grafana
· Data Processing & Management: Python, Apache Spark, Apache Kafka, AWS S3, Azure Data Lake Storage (ADLS), Delta Lake
· Workflow Automation: Apache Airflow, dbt, Apache NiFi, Fivetran, Airbyte, Great Expectations
· Data Catalogs: Amundsen, Collibra, Alation
· Threat Modeling & Security: AI-Specific Threat Modeling Tools, Secure ML Pipeline Tools, API Security Tools
· Monitoring & Prevention: AI Security Monitoring Tools, Prompt Injection Prevention Libraries, Adversarial Example Detection Libraries
· Ethics & Fairness: AI Ethics Frameworks and Tools, Bias Detection and Mitigation Tools, Fairness Metrics Libraries
· Privacy & Security: Privacy-Preserving Machine Learning Libraries, Robustness and Security Tools
·
