M

minio

Images for MinIO

Key platform data integrations repo

Projet de référence d'une architecture Lakehouse moderne appliquée à la détection de fraude bancaire.

Simule un environnement de production avec trois sources de données hétérogènes (fichiers CSV, base PostgreSQL, streaming Kafka/Redpanda) ingérées en continu vers un stockage objet S3-compatible (MinIO).

Stack technique :

Ingestion batch : Apache Spark (PySpark) + Delta Lake Ingestion streaming : Spark Structured Streaming + Redpanda (Kafka) Orchestration : Apache Airflow Transformation : dbt (DuckDB) Stockage : MinIO (S3), Delta Lake (Bronze/Silver), Parquet (Gold) Exploration : DuckDB / DBeaver

Architecture en médaillon (Medallion Architecture) :

Bronze : données brutes, sources séparées Silver : données nettoyées, déduplication inter-sources Gold : agrégats métier (fraude par heure)

L'ensemble de la stack tourne en local via Docker Compose.

A Homelab project designed to deploy Openstack (kolla-ansible) multinode infrastructure using Gitlab CI. It will evolve step by step with endless possibilities!

High Performance Object Storage for AI - Debian Package Repo

Boilerplate for creating a scalable FastAPI application with AI integrations

My adaptation of the Snakemake tutorial with Argo Workflows

MinIO monitoring template created for use in Zabbix 6.4, 7.0 and later

The diplom project (Infrastructure) of the Yandex practicum

Prometheus is a powerful open-source monitoring system that can be used to collect and track a variety of metrics for your applications. We will cover how to get Prometheus up and running with systemd on a Ubuntu or Debian server.

Setup minio monitoring.

The initial task of practical work on the course "DevOps for operation and development" https://gitlab.com/tekliuk-pet-project/sausage-store-initial-task Смотреть ветки

Ferramenta para a automação da instalação da aplicação Flask e do MinIO, que utiliza gunicorn3 para subir instancia para upload de arquivos.