Personal DIY Projects Management

Quote

Most of those topics which i consider for contributing and find out the best way to apply this functionality, if you find the same mindset or want to collaboration, feel free meet me. Always wait with some reason 😄😄😄

Note

The icon to telling you about what task is on progress or pending 😄

• ✍ : On progressing, It usually attaches with github and blog
• 🚧 : Pending, just stop like a note, and idea to doing something around that. Waiting for new information LOL
• ✅ : Already hand on and release as blog, , find in all blogs page
• ⌛ : On my way, just wait for couple weeks

DataOps and MLOps

Vector Database

Milvus Cluster ✅

Documentation: https://milvus.io/docs

Info

Try to learn and explore vector database of Linux Foundation Opensource, and try to practical with feature and grasp the infrastructure of milvus with kubewekend cluster

Check it out 👉 Articles: What is Milvus and First EKS Cluster with Milvus DB

Workflow Orchestration 🚧

Info

Find out and explore more about how to organization workflow in production, and how we implement one for yourself to practice and operate into real scenarios.

Tools and Technologies: Airflow, Airbyte, N8n, …

Change Data Capture (CDC) 🚧

Info

Learn about how we can grasp and stream the events change of database to another workload (e.g Data Flow, Data Pipelines, …) , database or data warehouse, how can we setup and operate the techniques for your application.

Tools and Technologies: Apache Flink, Apache Kafka, Debezium, …

Model Pipelines 🚧

Info

Go through and inspect about model pipelines, architecture and structure of them for increasing more efficiency for serving progressing

Tools and Technologies: Ray, KServe, vLLM, MLflow, …

Hackwekend

HTTP Tunneling for secure connection 🚧

Abstract

Tunneling the request to internet to HTTP and return response to currently browser like VPN but alternative

Reference techniques : ZTM (Zero Trust Mesh) , wstunnel

Lateral Movement Attack 🚧

Abstract

Find the way to perform LM, how affect of them, provisioning lab and find the way to patching it.

Kubewekend

Github: kubewekend Website: kubewekend.xeusnguyen.xyz

Abstract

Use the interesting and couple of candidate technologies for setting up Kubernetes cluster in locally. Learn and do some incredible thing with self-hosted and we capture that as the adventure to figure out and work with more concept of Kubernetes

The extra session ✍

• Session Extra 1: Longhorn and the story about NFS in Kubernetes ✅
• Session Extra 2: Rebuild Cluster with Rancher or K3S ✅
• Session Extra 3: Networking Issue in Kubernetes with CNI, CoreDNS ✅
• Session Extra 4: Kind and Sandbox environment for GitLab CI ✅
• Session Extra 5: Combination GitOps with ArgoCD into Kubewekend Cluster ✍
• Session Extra 6: Learn and use security, network context for Kubernetes ⌛
• Session Extra 7: Customize default scheduled in kubernetes cluster with kube-scheduler ⌛
• Session Extra 8: Service mesh inside Kubewekend Cluster ⌛
• Session Extra 9: Learn about virtualization inside Kubewekend with kubevirt ⌛

The major session ✍

• Session 1: Use Vargrant to configuration the VM with provider in VirtualBox ✅
• Session 2: Ansible - To setup and run script and bring up kubernetes cluster on locally, Use kind ✅
• Session 3: Exploring, understanding and provisioning require components inside the kind cluster ✅
• Session 4: cilium and ebpf - The powerful kernel service of kubewekend cluster ✅
• Session 5: How to build the High Availability (HA) Cluster. ✅
• Session 6: Use extend CSI for volume and storage class with Ceph ✅
• Session 7: Setup new app, use cilium to route traffic into cluster via gateway ✍
• Session 8: Setup the monitoring cluster inside the kubernetes with node-exporter, prometheus and grafana ✍
• Session 9: Setup tracing, logging, profiling components in kubewekend cluster ✍

WouOps

Pre-hook framework 🚧

Github: distribute-git-hook

Abstract

Create a framework on light weight and isolation components for check commit and push event in currently source code to repositories, with features like

• Code smell and validate code for improving the code quality
• Handling prehook for pentesting surface application on whitebox like secret leak, CVE, misconfiguration
• Offer the announcement location, can be grafana or report with dashboard about your commit

Sidecar for remote profiling applications 🚧

Abstract

Make a container can distribute and mental monitoring, profiling application with remotely by Sidecar pattern