Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
blog_post_video [2019/04/12 05:50]
root [Playlist Planning]
blog_post_video [2019/06/24 01:47] (current)
root [Micro-services]
Line 4: Line 4:
 == Playlist Planning ==  == Playlist Planning == 
  
-**Lego Playlist**+=== Python ===  
 +[[Pandas Notes]] 
 + 
 +=== Sense Hat === 
 + 
 +[[tutorial 1 - overview and setup]] and [[SenseHat]] 
 + 
 + 
 +=== Lego Playlist ​===
  
 * Garden * Garden
Line 20: Line 28:
 ** velocity, brakes, black box crash detection ​ ** velocity, brakes, black box crash detection ​
 ** camera follow lines ** camera follow lines
-** radar ?+** radar  ​https://​www.youtube.com/​watch?v=RKGUywtna10
  
  
Line 31: Line 39:
 ** obstacle avoidance ​ ** obstacle avoidance ​
    
 +* Fingerprint Reader ​
 +** https://​buysnip.com/​product/​r307-fingerprint-module/​
 +* Lego Self balancing (segway) robot https://​www.youtube.com/​watch?​v=MRsEFw7EHwo
 +* Lego letter/​barcode sorter
 +* coffee maker/​liquid dispenser https://​www.youtube.com/​watch?​v=JsaeaaDCsEc
  
-**Airflow Playlist** ​ 
  
 +===  Airflow Playlist === 
 * Getting started with Apache Airflow ​ * Getting started with Apache Airflow ​
 * Airflow and GCP  * Airflow and GCP 
  
-**Mule Playlist** +=== Mule Playlist ​=== 
  
 * munit testing with databases ​ * munit testing with databases ​
Line 43: Line 56:
 **Postgres Playlist** ​ **Postgres Playlist** ​
  
 +* [[https://​www.learndatasci.com/​tutorials/​using-databases-python-postgres-sqlalchemy-and-alembic/​ | Setting Python, Postgres and database Migrations with Alembic]]
 * Stored Procedures ​ * Stored Procedures ​
 ** Testing Stored Procedures ​ ** Testing Stored Procedures ​
 * Postgres Indexing ​ * Postgres Indexing ​
-* Postgres on GCP +* Postgres on GCP (and data tools https://​datastudio.google.com/​) ​
 * Time series data  * Time series data 
 * Geo-location data  * Geo-location data 
 ** article [[grafana mapping of ip addresses]] and my notes on [[Postgres Gis]] ** article [[grafana mapping of ip addresses]] and my notes on [[Postgres Gis]]
-* Text Search (sqlalchemy ) +* Full Text Search 
 +** [[Tutorial 1 - Create a word cloud from job advertisements]] 
 +** Text Search (sqlalchemy ) 
 * Postgres Role Security (integration with Vault?) and encryption * Postgres Role Security (integration with Vault?) and encryption
  
  
 +=== Home Automation === 
 +* Ikea/Xaomi home automation - python library here https://​github.com/​ggravlingen/​pytradfri
 +
 +===  AI/Machine Learning/​Data Science === 
 +* image recognition a bit like https://​www.youtube.com/​watch?​v=QSTnwsZj2yc
 +* demo examples of the 7 types of regression from [[python_machine_learning]]
 +* Nvidia Jetson Nano board sample [[https://​www.youtube.com/​watch?​v=BkZ1n_1F-Cg | youtube tutorial]]
 +* [[TensorFlow Notes]] 2.0 
 +* [[PyTorch Notes]] 1.0
 +* NLTK [[https://​www.learndatasci.com/​tutorials/​sentiment-analysis-reddit-headlines-pythons-nltk/​ | Sentiment Analysis on Reddit News Headlines with Python’s Natural Language Toolkit (NLTK)]]
 +* [[https://​www.learndatasci.com/​tutorials/​python-finance-part-3-moving-average-trading-strategy/​ | Creating moving averages]]
 +* [[scikit-learn notes]]
 +* [[OpenCV Notes]]
 +** [[tutorial 1 - Face Detection with OpenCV]]
 +
 +**Note:** can also be used with the Nvidia jetson Nano
 +* An alternative to OpenCV seems to be [[https://​pjreddie.com/​darknet/​yolo/​ | Yolo]] ​
 +
 +Plotly
 +* Graphing data with plotly ​
 +
 +
 +=== Micro-services === 
 +* [[https://​glasnostic.com/​blog/​how-canary-deployments-work-1-kubernetes-istio-linkerd ​ | Kubernetes, Istio and Linkerd]]
 +* [[https://​glasnostic.com/​blog/​what-is-a-service-mesh-istio-linkerd-envoy-consul | Service Mesh - istio linkerd envoy consul]]
 +* [[https://​www.getambassador.io/​ | Service Mesh - Istio and Ambassador]] which seems to be more Azure supported ​
 +
 +=== Grafana Playlist === 
 +* Example Youtube tutorial https://​www.youtube.com/​watch?​v=sKNZMtoSHN4
 +* Setup your grafana on a [[ https://​blog.monstermuffin.org/​making-a-raspberry-pi-grafana-monitor/​ | monitor with a rasberry pi]]
 +
 +
 +=== Timescale db Playlist === 
 +* The Sunspot tutorial ​
 +** tutorial 1 - using python to grab sunspot data and store it in timescale DB
 +** tutorial 2 - graphing sunspot data in grafana ​
 +** tutorial 3 - calculating averages and smoothing the graph 
 +** tutorial 4 - predicting future sunspot trend 
 +** tutorial 5 - using anomaly detection to alert for the end of the world 
 +
 +**Note** this could be replayed on the elastic playlist and plotly
  
-=== timescale db Playlist ===  
 * social media monitoring (google and timescale) * social media monitoring (google and timescale)
 +* anomaly detection ​
 +* reproduce Cyber Squirrel 1 https://​cybersquirrel1.com/​ with grafana maps, gis
  
 +=== Terraform Playlist == 
 +Basics:
 +* AWS deployment ​
 +* Gcp deployment ​
 +* Azure deployment ​
 +* monitoring deployment
  
-=== Google ​Cloud GCP Playlist ===+== Cloud Networking and SDN == 
  
 +* Blog [[http://​vcloudynet.blogspot.com/​2017/​03/​how-to-setup-vpc-peering-with-terraform.html |  how to setup VPC Peering with Terraform]]
 +
 +== Kubernates Playlist == 
 +* Helm 
 +* [[ https://​istio.io/​docs/​examples/​bookinfo/​ | Istio ] Envoy and micro services ​
 +== Streaming Solutions == 
 +* Kafka 
 +** [[https://​blog.scottlogic.com/​2017/​10/​13/​MetOfficeKafka.html | Ingest Met Data on Kafka]]
 +* Apache pulsar ​
 +* AWS/​GCP/​Azure versions
 +
 +=== Google Cloud GCP Playlist ===
 +[[GCP Notes]]
 * Intro app engine .. my version of https://​www.youtube.com/​watch?​v=sATG0OfdP4g * Intro app engine .. my version of https://​www.youtube.com/​watch?​v=sATG0OfdP4g
 * Sanic (on GCP) App engine * Sanic (on GCP) App engine
Line 67: Line 144:
 * CDN and scaling applications on Google App Engine ​ * CDN and scaling applications on Google App Engine ​
 * Deploy docker gcp and ..demonstrate,​ measure and cost scaling ​ * Deploy docker gcp and ..demonstrate,​ measure and cost scaling ​
 +* GCP api with API Endpoints
  
  
  
  
-== DevOps Playlist ​ == +== DevOps ​DecSecOps ​Playlist ​ == 
-* [[https://testdriven.io/​blog/​running-flask-on-kubernetes/?source=4320ef6a6395 |  A full article to spin up flask on kuberantes]]+{{ https://i.redd.it/hl88jf9jc5r11.png?300px}}
  
 +*  A full [[https://​testdriven.io/​blog/​running-flask-on-kubernetes/?​source=4320ef6a6395 | article]] to spin up flask on kubernates
 +* [[Terraform]]
 +* [[Consul]] - Consul is a distributed service mesh to connect, secure, and configure services across any runtime platform and public or private cloud
 +* [[Packer]] - a tool for creating identical machine images for multiple platforms from a single source configuration ​
 +* [[https://​gophp.io/​how-to-use-pi-hole-to-block-all-ads-on-your-local-network/​ | Pi-hole]] is a simple tool which can be configured to handle the DNS of all the devices on a network. It can be installed on a linux environment and is also available as a docker image. Basically it will check any DNS queries against various blacklists and block queries that match ad networks or tracking domains. The end result is that you get a browsing experience without advertisements and user tracking
 +* Endpoint and Api monitoring with [[https://​support.smartbear.com/​alertsite/​docs/​index.html | Smartbear Alertsite]] also has references to Swagger api monitoring ​
 +*  A [[ https://​www.rtl-sdr.com/​the-radioinstigator-a-150-signals-intelligence-platform-consisting-of-a-raspberry-pi-rpitx-2-4-ghz-crazyradio-and-an-rtl-sdr/ ​ | $150 SIGNALS INTELLIGENCE PLATFORM]] CONSISTING OF A RASPBERRY PI, RPITX, 2.4 GHZ CRAZYRADIO AND AN RTL-SDR
 +* Pi Hole [[https://​pi-hole.net/​ | block ads ]] and grafana display, see image to the right -->
 +* Write a [[https://​www.peerlyst.com/​posts/​how-to-build-a-machine-learning-intrusion-detection-system-chiheb-chebbi?​utm_source=twitter&​utm_medium=social&​utm_content=peerlyst_post&​utm_campaign=peerlyst_shared_post | Machine Learning Intrusion Detection]] ​
 +* Deploy [[https://​blog.docker.com/​2019/​03/​happy-pi-day-docker-raspberry-pi/​ | Docker Swarm]] to 7 rasberry pi cluster ​
  
-**WagTail Playlist** ​ 
  
- +== Video Capture and Promotion ​== 
-**Video Capture and Promotion**+
  
 * Capturing Tutorials in OBS https://​obsproject.com/​ * Capturing Tutorials in OBS https://​obsproject.com/​
  
 +== Misc ==  
 +* [[https://​www.youtube.com/​watch?​v=Ngns3xMmung | Raspberry Pi Drum Machine]] 
 +== Links and Reference ==  
 +* [[https://​learning.kidzcancode.com/​course/​interacting-with-the-real-world-using-the-sense-hat-on-the-raspberry-pi/​ | Kids can Code]] ​
 
blog_post_video.1555073430.txt.gz · Last modified: 2019/04/12 05:50 by root
 
RSS - 200 © CrosswireDigitialMedia Ltd