Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
home [2019/10/29 06:20]
root [DevSecOps]
home [2020/06/01 02:01] (current)
root [AWS Notes]
Line 25: Line 25:
 ** [[http://​www.pippo.ro/​ | pippo]] ​ ** [[http://​www.pippo.ro/​ | pippo]] ​
 ** [[vertx]] ** [[vertx]]
-*** [[apiman]] + 
-*** Service discovery [[consul]] +Graal Vm Compatible Microservices:​ 
-Misc +[[https://​codurance.es/​2018/​12/​28/​native-microservices-with-sparkjava-and-graal/​ | Spark Java]] 
 +[[https://​micronaut.io/​ | Micronaut]] - A modern, JVM-based, full-stack framework for building modular, easily testable microservice applications. 
 +* [[https://​quarkus.io/​ | Quarkus]] A Kubernetes Native Java stack tailored for OpenJDK HotSpot and GraalVM, crafted from the best of breed Java libraries and standards. 
 + 
 +Api Gateways  
 +* [[apiman]] 
 +[[ibm datapower]] 
 + 
 +Cloud Comms Mgt  
 +* Service discovery [[consul]] ​- also security authentication when used with [[vault]] or [[forgerock]] 
 + 
 + 
 + 
 + 
 +== Gradle ==  
 +* [[Gradle]] Notes 
 +** [[Gradle Docker]] 
 +** [[Gradle Openshift]] 
 +** [[Gradle Docker and TestContainers]] 
 +** [[Gradle yml templates]] 
 +** [[Gradle Plugins]] 
 + 
 +== Misc ==  ​
 * [[Dropwizard Metrics]] that has become a popular extension in other frameworks ​ * [[Dropwizard Metrics]] that has become a popular extension in other frameworks ​
 * [[Kotlin]], [[Kotlin native]] and  [[Kotlin Javascript]] * [[Kotlin]], [[Kotlin native]] and  [[Kotlin Javascript]]
Line 36: Line 58:
 ** [[Grails]] Notes and [[Gorm]] notes ** [[Grails]] Notes and [[Gorm]] notes
 ** [[Spock]] Notes  ** [[Spock]] Notes 
-** [[Gradle]] Notes 
 * [[Javascript]] , [[Javascript Toolkits]], [[AngularJs]] ..note you can now load dependencies with http://​www.webjars.org/​ * [[Javascript]] , [[Javascript Toolkits]], [[AngularJs]] ..note you can now load dependencies with http://​www.webjars.org/​
 ** [[Vue.js]] and mobile natvie version [[https://​www.nativescript.org/​ | nativeScript]] and more generic [[https://​gonative.io/​examples | gonative]] ** [[Vue.js]] and mobile natvie version [[https://​www.nativescript.org/​ | nativeScript]] and more generic [[https://​gonative.io/​examples | gonative]]
Line 71: Line 92:
 * [[Go Language Notes]] * [[Go Language Notes]]
 * [[Go Applications]] * [[Go Applications]]
 +* [[https://​github.com/​google/​ko | Google Ko]] Building Go and deploying on Kubernates
 == Python ==  == Python == 
  
Line 82: Line 103:
 ** [[Python Async]] ** [[Python Async]]
 ** [[Python Pandas]] ** [[Python Pandas]]
-** [[Python Machine Learning]]+** [[Python Machine Learning]] ​scaling machine learning https://​dask.org/​
 ** [[Postgres Machine Learning]] ** [[Postgres Machine Learning]]
 ** [[Postgres graph and madlib]] ** [[Postgres graph and madlib]]
Line 94: Line 115:
 * [[TensorFlow Notes]] 2.0 * [[TensorFlow Notes]] 2.0
 * [[PyTorch Notes]] 1.0 * [[PyTorch Notes]] 1.0
 +* Kubeflow - Kubeflow is an open, community driven project to make it easy to deploy and manage an ML stack on Kubernetes
  
 == Api Mgt ==  == Api Mgt == 
 * [[Api Gateways]] * [[Api Gateways]]
 +* [[Cloud Native]] Ambassador, Tyko, Kong
  
 +=== Api/Service Mesh === 
 +- [[Service Mesh]] Linkderd ​
  
 == Testing == == Testing ==
Line 136: Line 160:
 == Build Tools ==  == Build Tools == 
 * [[Maven]] * [[Maven]]
 +* [[Gradle]]
  
 == Test Tools ==  == Test Tools == 
Line 219: Line 244:
 * [[parquet]],​ Avro * [[parquet]],​ Avro
  
-==== Json Store ===+==  ​Elastic ​== 
 * [[Elastic Search]] ​ * [[Elastic Search]] ​
 ** [[Kibana]] ** [[Kibana]]
-** [[Timelion]] ​+** Writing [[Kibana plugins]] 
 +** [[Timelion]] 
 +** [[Pipelines]] 
 * [[Elastic Engineer 1]] * [[Elastic Engineer 1]]
 * [[Elastic APM]] * [[Elastic APM]]
 +* [[Elastic filebeats]]
 +* [[Elastic metric beats]]
 +* [[Elastic Uptime Monitor]]
 +* [[Elastic Infastructure]]
 +* [[Elastic Lens]]
 +* [[Elastic Logstash]]
  
 EFK (ElasticSearch,​ Fluentd, Kibana) EFK (ElasticSearch,​ Fluentd, Kibana)
 * [[Fluentd]] * [[Fluentd]]
  
 +== Other Visualisations == 
 +* https://​github.com/​finos/​perspective - very fast rendering based on webassembley
 +* https://​github.com/​uwdata/​falcon - Similar in memory very fast visualisation
 +
 +==== Json Store ===
 Others: Others:
 * Solr Notes, [[Embedding Solr]] ​ * Solr Notes, [[Embedding Solr]] ​
 * [[couchbase]] * [[couchbase]]
 * Java json path query https://​github.com/​jayway/​JsonPath library * Java json path query https://​github.com/​jayway/​JsonPath library
 +
  
 === DB Migrations === === DB Migrations ===
Line 279: Line 318:
  
 == MetOps/​DataOps == == MetOps/​DataOps ==
 +
 +* [[https://​github.com/​chen1649chenli/​dataOpsResource | Awesome DataOps]] list 
  
 Metics and Goal setting ​ Metics and Goal setting ​
Line 305: Line 346:
 Alerting: Alerting:
 * https://​alerta.io/​ * https://​alerta.io/​
 +
 +Tracing ​
 +* https://​www.jaegertracing.io/​ End to end distributed tracing (which works with zipkin)
 +* https://​zipkin.io/​ Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data.
  
 Flask based dashboard ​ Flask based dashboard ​
Line 350: Line 395:
  
 * [[EMC'​s Options]] * [[EMC'​s Options]]
 +
 +Although Apache Spark and Apache Ignite both carries the power of in-memory computing, Still they have some conceptual differences:​
 +
 +Spark doesn’t store data, actually it loads data from other storages for processing purpose, usually disk-based. As soon as the processing is finished it discards the data. On the other hand, Ignite provides a distributed in-memory key-value store (distributed cache or data grid) with SQL querying capabilities and ACID transactions.
 +
 +Spark is used for non-transactional,​ read-only data (RDDs don’t support in-place mutation), while Ignite supports both fully ACID compliant transactions (OLTP) and non-transactional (OLAP) payloads.
 +
  
 Data Analytics ​ Data Analytics ​
Line 375: Line 427:
  
 == Stream Processsing ==  == Stream Processsing == 
-* [[kafka]] and [[python kafka]]+* [[kafka]] and [[python kafka]]  and [[https://​github.com/​yahoo/​CMAK | kafka manager]] 
 +** http://​curator.apache.org/​ Zookeeper manager -  a distributed coordination service. It includes a highlevel API framework and utilities to make using Apache ZooKeeper 
 +* kafka [[ksql]]
 *  http://​samza.incubator.apache.org/​ *  http://​samza.incubator.apache.org/​
 * It’s worth noting that Cassandra or HBase can be used a resequencing buffer, this technique is described in http://​www.slideshare.net/​dave_revell/​nearrealtime-analytics-with-kafka-and-hbase * It’s worth noting that Cassandra or HBase can be used a resequencing buffer, this technique is described in http://​www.slideshare.net/​dave_revell/​nearrealtime-analytics-with-kafka-and-hbase
Line 463: Line 517:
 == Links ==  == Links == 
 * [[srm links]] * [[srm links]]
-* [[Ricston links]] 
 * [[javascript framework links]] * [[javascript framework links]]
  
Line 485: Line 538:
 * [[http://​www.lavishbootstrap.com/​ Lavish]] extract the colors from a photo and provide a bootstrap css template * [[http://​www.lavishbootstrap.com/​ Lavish]] extract the colors from a photo and provide a bootstrap css template
  
-== Configuration Mgt ==+== Agile ==  
 +* [[Agile Development]] 
 +== DevOps ​==
 * [[jenkins]] * [[jenkins]]
 +** [[Jenkins groovy dsl]]
 +
 +
 * [[Puppet, Chef, SaltStack, and Ansible]] and glu * [[Puppet, Chef, SaltStack, and Ansible]] and glu
 ** [[Puppet Notes]] ** [[Puppet Notes]]
 * [[Terraform notes]] * [[Terraform notes]]
 +** [[Jenkins - Terraform]]
 * [[openStack]] * [[openStack]]
 * Monitoring [[http://​stackhunter.com/​ | stackhunter]] * Monitoring [[http://​stackhunter.com/​ | stackhunter]]
-* [[openShift]]+* [[Docker]] 
 +** local [[docker registry]] 
 + 
 +* Kubernates CI/CD - Cloud native solutions  
 +** Tekton https://​cloud.google.com/​tekton 
 +** ArgoCI, JenkinsX  
 +** [[Openshift Jenkins]] 
 +** [[Openshift Jenkins Terraform]] 
 +** [[Kubernates Jenkins]] 
 +=== Elastic Search ===  
 +* [[Elastic Search]]  
 +** [[Kibana]] 
 +** [[Timelion]]  
 +* [[Elastic Engineer 1]] 
 +* [[Elastic APM]] 
 +* [[Elastic filebeats]] 
 +* [[Elastic metric beats]] 
 +* [[Elastic Uptime Monitor]] 
 + 
 +=== Ansible ===  
 +* [[Ansible]] basics  
 +** [[Ansible Openshift]] 
 +** [[Ansible Gcloud]] 
 +** [[Ansible Operators]] 
 +== OpenShift ==  
 +* [[openShift]] ​overview and [[OC command]]  
 +**[[Openshift Template]] 
 +**[[Openshift Routes]] 
 +**[[Openshift Certificates]] 
 +**[[Openshift Clusters]] 
 +**[[Openshift Deployments]] templates, config, rollback etc.  
 +**[[Openshift Monitoring]] - including metrics 
 +**[[Openshift roles and security]] settings 
 +** [[Build and import and image]] 
 + 
 +* Openshift development [[minishift]] Openshift 4 [[Code Ready Containers CRC]] 
 +** [[Accessing Openshift]] cluster externally, including Kafka 
 + 
 +Monitoring and Management  
 +* [[Openshift Jenkins]] 
 +* [[Openshift Jenkins Terraform]] 
 +* [[Openshift Security]] and secrets with Vault  
 + 
 +Enterprise Deployments 
 +* [[Dual Site Deployemnts]] deploying-openshift-applications-multiple-datacenters/​ 
 + 
 +On other platforms  
 +*[[Openshift on GCP]] or [[Openshift on Azure]] and [[Openshift on AWS]] 
 + 
 +*[[Openshift 4]] 
 +* https://​docs.okd.io/ ​ OKD is a distribution of Kubernetes optimized for continuous application development and multi-tenant deployment. OKD also serves as the upstream code base upon which Red Hat OpenShift Online and Red Hat OpenShift Container Platform are built. 
 + 
 * [[https://​kapitan.dev/​]] a json/yml file property manager to (intally ) drive devops ​ * [[https://​kapitan.dev/​]] a json/yml file property manager to (intally ) drive devops ​
 +
 +Application Development ​
 * consul from Hashicorp - Consul is a distributed,​ highly-available,​ and multi-datacenter aware tool for service discovery, configuration,​ and orchestration * consul from Hashicorp - Consul is a distributed,​ highly-available,​ and multi-datacenter aware tool for service discovery, configuration,​ and orchestration
 +* [[Redhat ServieMesh]] Istio on OpenShift
  
 See also  See also 
Line 502: Line 616:
 ** Powerful configuration mechanisms (interface binding, multi-source support with fallback strategy, merging, ...) ** Powerful configuration mechanisms (interface binding, multi-source support with fallback strategy, merging, ...)
 ** Distributed-environment friendly ( caching, support for multiple environments [test, preprod, prod], ...) ** Distributed-environment friendly ( caching, support for multiple environments [test, preprod, prod], ...)
 +
 +== Cloud Storage == 
 +* [[Cloudian Hyperstore]]
  
 === DevSecOps ===  === DevSecOps === 
-* Hashicorp Vault and the nice vuejs front end https://​vault-ui.io/​ [[vault notes]] .. and [[https://​dzone.com/​articles/​ansible-vault | Ansible Vault]]+* Hashicorp Vault and the nice vuejs front end https://​vault-ui.io/​ [[vault notes]] .. and  
 +[[https://​dzone.com/​articles/​ansible-vault | Ansible Vault]] 
 +* Similarly [[forgerock]] 
 * [[https://​www.pingidentity.com/​content/​ping/​en.html | Ping]] auth and identity mgt  ​ * [[https://​www.pingidentity.com/​content/​ping/​en.html | Ping]] auth and identity mgt  ​
 * [[Consul]] - Consul is a distributed service mesh to connect, secure, and configure services across any runtime platform and public or private cloud * [[Consul]] - Consul is a distributed service mesh to connect, secure, and configure services across any runtime platform and public or private cloud
Line 513: Line 632:
  
 * [[credentials management]] * [[credentials management]]
 +
 +Configuration Management:
 +* [[https://​github.com/​ManageIQ/​manageiq | ManageIq]]
 +
 +Ci/CD
 +* [[devSec Gradle Plugins]]
 == Video ==  == Video == 
  
Line 533: Line 658:
 * [[http://​themeforest.net/​item/​material-resume-cv-vcard/​13703959?​s_rank=1 | resume template * [[http://​themeforest.net/​item/​material-resume-cv-vcard/​13703959?​s_rank=1 | resume template
 ]] ]]
-* [[http://​themeforest.net/​item/​businessbox-corporate-business-template/​5180049?​WT.ac=search_thumb&​WT.oss_phrase=corporate&​WT.oss_rank=9&​WT.z_author=trendyWebStar | potential Ricston]]+
  
  
Line 588: Line 713:
  
 IBM's Bluemix ​ IBM's Bluemix ​
 +* [[IBM Cloud]]
 * [[http://​openwhisk.incubator.apache.org/​ | openwhisk]] the lambda equivalent ​ * [[http://​openwhisk.incubator.apache.org/​ | openwhisk]] the lambda equivalent ​
 * [[Api Connect]] * [[Api Connect]]
Line 593: Line 719:
 * [[App Id]] * [[App Id]]
 * [[serverless]] framework ​ * [[serverless]] framework ​
 +
 +=== Kubernates ===
 * [[kubernates]] * [[kubernates]]
 ** [[Getting Started for Development]] - with miniKube ** [[Getting Started for Development]] - with miniKube
Line 600: Line 728:
 ** [[Kubernates Azure]] ** [[Kubernates Azure]]
 ** [[Kubernates Ingress Controllers]] including traefik ** [[Kubernates Ingress Controllers]] including traefik
 +** [[Kubernates Security]]
 +** [[Cloud native storage]] Rook
 +** [[Kubernates Monitoring]] including readinessProbes etc. 
 +** [[Gradle Kubernates]] ​
 +** [[Kubernates Daemonsets]]
 +** [[Kubernates Rasberry Pi]]
 * [[Openshift]] * [[Openshift]]
  
Line 632: Line 766:
 * [[Financial Apps, Api'​s]] * [[Financial Apps, Api'​s]]
 * [[Jira Api]] * [[Jira Api]]
-* Ricston [[https://​docs.google.com/​a/​ricston.com/​spreadsheet/​ccc?​key=0AjynU6mIbKbadF9VTnpNdHZvOWU4QkdUalZwUnFXa3c&​usp=drive_web#​gid=9 | work resources]] +
-Screen share +
 * http://​www.ScreenLeap.com ​ * http://​www.ScreenLeap.com ​
 * [[nlp]] * [[nlp]]
Line 707: Line 840:
 == Rasberry Pi and Ubuntu Core ==  == Rasberry Pi and Ubuntu Core == 
 * [[Step 1 setup wireless networking]] * [[Step 1 setup wireless networking]]
-* [[Step 2 add ssh server and connect]]+* [[Step 2 add ssh server and connect]]A
  
 +== Alchemy == 
 +* [[Alchemical Tarot]]
 
home.1572355228.txt.gz · Last modified: 2019/10/29 06:20 by root
 
RSS - 200 © CrosswireDigitialMedia Ltd