Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
home [2019/10/01 06:56]
root [Alibaba]
home [2020/06/01 02:01] (current)
root [AWS Notes]
Line 25: Line 25:
 ** [[http://​www.pippo.ro/​ | pippo]] ​ ** [[http://​www.pippo.ro/​ | pippo]] ​
 ** [[vertx]] ** [[vertx]]
-*** [[apiman]] + 
-*** Service discovery [[consul]] +Graal Vm Compatible Microservices:​ 
-Misc +[[https://​codurance.es/​2018/​12/​28/​native-microservices-with-sparkjava-and-graal/​ | Spark Java]] 
 +[[https://​micronaut.io/​ | Micronaut]] - A modern, JVM-based, full-stack framework for building modular, easily testable microservice applications. 
 +* [[https://​quarkus.io/​ | Quarkus]] A Kubernetes Native Java stack tailored for OpenJDK HotSpot and GraalVM, crafted from the best of breed Java libraries and standards. 
 + 
 +Api Gateways  
 +* [[apiman]] 
 +[[ibm datapower]] 
 + 
 +Cloud Comms Mgt  
 +* Service discovery [[consul]] ​- also security authentication when used with [[vault]] or [[forgerock]] 
 + 
 + 
 + 
 + 
 +== Gradle ==  
 +* [[Gradle]] Notes 
 +** [[Gradle Docker]] 
 +** [[Gradle Openshift]] 
 +** [[Gradle Docker and TestContainers]] 
 +** [[Gradle yml templates]] 
 +** [[Gradle Plugins]] 
 + 
 +== Misc ==  ​
 * [[Dropwizard Metrics]] that has become a popular extension in other frameworks ​ * [[Dropwizard Metrics]] that has become a popular extension in other frameworks ​
 * [[Kotlin]], [[Kotlin native]] and  [[Kotlin Javascript]] * [[Kotlin]], [[Kotlin native]] and  [[Kotlin Javascript]]
Line 36: Line 58:
 ** [[Grails]] Notes and [[Gorm]] notes ** [[Grails]] Notes and [[Gorm]] notes
 ** [[Spock]] Notes  ** [[Spock]] Notes 
-** [[Gradle]] Notes 
 * [[Javascript]] , [[Javascript Toolkits]], [[AngularJs]] ..note you can now load dependencies with http://​www.webjars.org/​ * [[Javascript]] , [[Javascript Toolkits]], [[AngularJs]] ..note you can now load dependencies with http://​www.webjars.org/​
 ** [[Vue.js]] and mobile natvie version [[https://​www.nativescript.org/​ | nativeScript]] and more generic [[https://​gonative.io/​examples | gonative]] ** [[Vue.js]] and mobile natvie version [[https://​www.nativescript.org/​ | nativeScript]] and more generic [[https://​gonative.io/​examples | gonative]]
Line 71: Line 92:
 * [[Go Language Notes]] * [[Go Language Notes]]
 * [[Go Applications]] * [[Go Applications]]
 +* [[https://​github.com/​google/​ko | Google Ko]] Building Go and deploying on Kubernates
 == Python ==  == Python == 
  
Line 82: Line 103:
 ** [[Python Async]] ** [[Python Async]]
 ** [[Python Pandas]] ** [[Python Pandas]]
-** [[Python Machine Learning]]+** [[Python Machine Learning]] ​scaling machine learning https://​dask.org/​
 ** [[Postgres Machine Learning]] ** [[Postgres Machine Learning]]
 ** [[Postgres graph and madlib]] ** [[Postgres graph and madlib]]
Line 94: Line 115:
 * [[TensorFlow Notes]] 2.0 * [[TensorFlow Notes]] 2.0
 * [[PyTorch Notes]] 1.0 * [[PyTorch Notes]] 1.0
 +* Kubeflow - Kubeflow is an open, community driven project to make it easy to deploy and manage an ML stack on Kubernetes
  
 == Api Mgt ==  == Api Mgt == 
 * [[Api Gateways]] * [[Api Gateways]]
 +* [[Cloud Native]] Ambassador, Tyko, Kong
  
 +=== Api/Service Mesh === 
 +- [[Service Mesh]] Linkderd ​
  
 == Testing == == Testing ==
Line 136: Line 160:
 == Build Tools ==  == Build Tools == 
 * [[Maven]] * [[Maven]]
 +* [[Gradle]]
  
 == Test Tools ==  == Test Tools == 
Line 219: Line 244:
 * [[parquet]],​ Avro * [[parquet]],​ Avro
  
-==== Json Store ===+==  ​Elastic ​== 
 * [[Elastic Search]] ​ * [[Elastic Search]] ​
 ** [[Kibana]] ** [[Kibana]]
-** [[Timelion]] ​+** Writing [[Kibana plugins]] 
 +** [[Timelion]] 
 +** [[Pipelines]] 
 * [[Elastic Engineer 1]] * [[Elastic Engineer 1]]
 * [[Elastic APM]] * [[Elastic APM]]
 +* [[Elastic filebeats]]
 +* [[Elastic metric beats]]
 +* [[Elastic Uptime Monitor]]
 +* [[Elastic Infastructure]]
 +* [[Elastic Lens]]
 +* [[Elastic Logstash]]
  
 EFK (ElasticSearch,​ Fluentd, Kibana) EFK (ElasticSearch,​ Fluentd, Kibana)
 * [[Fluentd]] * [[Fluentd]]
  
 +== Other Visualisations == 
 +* https://​github.com/​finos/​perspective - very fast rendering based on webassembley
 +* https://​github.com/​uwdata/​falcon - Similar in memory very fast visualisation
 +
 +==== Json Store ===
 Others: Others:
 * Solr Notes, [[Embedding Solr]] ​ * Solr Notes, [[Embedding Solr]] ​
 * [[couchbase]] * [[couchbase]]
 * Java json path query https://​github.com/​jayway/​JsonPath library * Java json path query https://​github.com/​jayway/​JsonPath library
 +
  
 === DB Migrations === === DB Migrations ===
Line 278: Line 317:
  
  
-== MetOps ==+== MetOps/​DataOps ​== 
 + 
 +* [[https://​github.com/​chen1649chenli/​dataOpsResource | Awesome DataOps]] list 
  
 Metics and Goal setting ​ Metics and Goal setting ​
Line 305: Line 346:
 Alerting: Alerting:
 * https://​alerta.io/​ * https://​alerta.io/​
 +
 +Tracing ​
 +* https://​www.jaegertracing.io/​ End to end distributed tracing (which works with zipkin)
 +* https://​zipkin.io/​ Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data.
  
 Flask based dashboard ​ Flask based dashboard ​
Line 350: Line 395:
  
 * [[EMC'​s Options]] * [[EMC'​s Options]]
 +
 +Although Apache Spark and Apache Ignite both carries the power of in-memory computing, Still they have some conceptual differences:​
 +
 +Spark doesn’t store data, actually it loads data from other storages for processing purpose, usually disk-based. As soon as the processing is finished it discards the data. On the other hand, Ignite provides a distributed in-memory key-value store (distributed cache or data grid) with SQL querying capabilities and ACID transactions.
 +
 +Spark is used for non-transactional,​ read-only data (RDDs don’t support in-place mutation), while Ignite supports both fully ACID compliant transactions (OLTP) and non-transactional (OLAP) payloads.
 +
  
 Data Analytics ​ Data Analytics ​
Line 375: Line 427:
  
 == Stream Processsing ==  == Stream Processsing == 
-* [[kafka]] and [[python kafka]]+* [[kafka]] and [[python kafka]]  and [[https://​github.com/​yahoo/​CMAK | kafka manager]] 
 +** http://​curator.apache.org/​ Zookeeper manager -  a distributed coordination service. It includes a highlevel API framework and utilities to make using Apache ZooKeeper 
 +* kafka [[ksql]]
 *  http://​samza.incubator.apache.org/​ *  http://​samza.incubator.apache.org/​
 * It’s worth noting that Cassandra or HBase can be used a resequencing buffer, this technique is described in http://​www.slideshare.net/​dave_revell/​nearrealtime-analytics-with-kafka-and-hbase * It’s worth noting that Cassandra or HBase can be used a resequencing buffer, this technique is described in http://​www.slideshare.net/​dave_revell/​nearrealtime-analytics-with-kafka-and-hbase
Line 428: Line 482:
 Talend ​ Talend ​
 * [[Talend Notes]] * [[Talend Notes]]
 +
 +StreamSets ​
 +* [[StreamSets]]
 +* [[StreamSets Python]]
 +* [[Scaling Streamsets on Kubernates]]
  
 == Data Ops ==  == Data Ops == 
Line 458: Line 517:
 == Links ==  == Links == 
 * [[srm links]] * [[srm links]]
-* [[Ricston links]] 
 * [[javascript framework links]] * [[javascript framework links]]
  
Line 480: Line 538:
 * [[http://​www.lavishbootstrap.com/​ Lavish]] extract the colors from a photo and provide a bootstrap css template * [[http://​www.lavishbootstrap.com/​ Lavish]] extract the colors from a photo and provide a bootstrap css template
  
-== Configuration Mgt ==+== Agile ==  
 +* [[Agile Development]] 
 +== DevOps ​==
 * [[jenkins]] * [[jenkins]]
 +** [[Jenkins groovy dsl]]
 +
 +
 * [[Puppet, Chef, SaltStack, and Ansible]] and glu * [[Puppet, Chef, SaltStack, and Ansible]] and glu
 ** [[Puppet Notes]] ** [[Puppet Notes]]
 * [[Terraform notes]] * [[Terraform notes]]
 +** [[Jenkins - Terraform]]
 * [[openStack]] * [[openStack]]
 * Monitoring [[http://​stackhunter.com/​ | stackhunter]] * Monitoring [[http://​stackhunter.com/​ | stackhunter]]
-* [[openShift]]+* [[Docker]] 
 +** local [[docker registry]] 
 + 
 +* Kubernates CI/CD - Cloud native solutions  
 +** Tekton https://​cloud.google.com/​tekton 
 +** ArgoCI, JenkinsX  
 +** [[Openshift Jenkins]] 
 +** [[Openshift Jenkins Terraform]] 
 +** [[Kubernates Jenkins]] 
 +=== Elastic Search ===  
 +* [[Elastic Search]]  
 +** [[Kibana]] 
 +** [[Timelion]]  
 +* [[Elastic Engineer 1]] 
 +* [[Elastic APM]] 
 +* [[Elastic filebeats]] 
 +* [[Elastic metric beats]] 
 +* [[Elastic Uptime Monitor]] 
 + 
 +=== Ansible ===  
 +* [[Ansible]] basics  
 +** [[Ansible Openshift]] 
 +** [[Ansible Gcloud]] 
 +** [[Ansible Operators]] 
 +== OpenShift ==  
 +* [[openShift]] ​overview and [[OC command]]  
 +**[[Openshift Template]] 
 +**[[Openshift Routes]] 
 +**[[Openshift Certificates]] 
 +**[[Openshift Clusters]] 
 +**[[Openshift Deployments]] templates, config, rollback etc.  
 +**[[Openshift Monitoring]] - including metrics 
 +**[[Openshift roles and security]] settings 
 +** [[Build and import and image]] 
 + 
 +* Openshift development [[minishift]] Openshift 4 [[Code Ready Containers CRC]] 
 +** [[Accessing Openshift]] cluster externally, including Kafka 
 + 
 +Monitoring and Management  
 +* [[Openshift Jenkins]] 
 +* [[Openshift Jenkins Terraform]] 
 +* [[Openshift Security]] and secrets with Vault  
 + 
 +Enterprise Deployments 
 +* [[Dual Site Deployemnts]] deploying-openshift-applications-multiple-datacenters/​ 
 + 
 +On other platforms  
 +*[[Openshift on GCP]] or [[Openshift on Azure]] and [[Openshift on AWS]] 
 + 
 +*[[Openshift 4]] 
 +* https://​docs.okd.io/ ​ OKD is a distribution of Kubernetes optimized for continuous application development and multi-tenant deployment. OKD also serves as the upstream code base upon which Red Hat OpenShift Online and Red Hat OpenShift Container Platform are built. 
 + 
 * [[https://​kapitan.dev/​]] a json/yml file property manager to (intally ) drive devops ​ * [[https://​kapitan.dev/​]] a json/yml file property manager to (intally ) drive devops ​
 +
 +Application Development ​
 * consul from Hashicorp - Consul is a distributed,​ highly-available,​ and multi-datacenter aware tool for service discovery, configuration,​ and orchestration * consul from Hashicorp - Consul is a distributed,​ highly-available,​ and multi-datacenter aware tool for service discovery, configuration,​ and orchestration
 +* [[Redhat ServieMesh]] Istio on OpenShift
  
 See also  See also 
Line 497: Line 616:
 ** Powerful configuration mechanisms (interface binding, multi-source support with fallback strategy, merging, ...) ** Powerful configuration mechanisms (interface binding, multi-source support with fallback strategy, merging, ...)
 ** Distributed-environment friendly ( caching, support for multiple environments [test, preprod, prod], ...) ** Distributed-environment friendly ( caching, support for multiple environments [test, preprod, prod], ...)
 +
 +== Cloud Storage == 
 +* [[Cloudian Hyperstore]]
  
 === DevSecOps ===  === DevSecOps === 
-* Hashicorp Vault and the nice vuejs front end https://​vault-ui.io/​ [[vault notes]]+* Hashicorp Vault and the nice vuejs front end https://​vault-ui.io/​ [[vault notes]] .. and  
 +[[https://​dzone.com/​articles/​ansible-vault | Ansible Vault]] 
 +* Similarly [[forgerock]] 
 * [[https://​www.pingidentity.com/​content/​ping/​en.html | Ping]] auth and identity mgt  ​ * [[https://​www.pingidentity.com/​content/​ping/​en.html | Ping]] auth and identity mgt  ​
 * [[Consul]] - Consul is a distributed service mesh to connect, secure, and configure services across any runtime platform and public or private cloud * [[Consul]] - Consul is a distributed service mesh to connect, secure, and configure services across any runtime platform and public or private cloud
Line 505: Line 629:
 * [[Packer]] - a tool for creating identical machine images for multiple platforms from a single source configuration * [[Packer]] - a tool for creating identical machine images for multiple platforms from a single source configuration
 * [[https://​www.sumologic.com/​ | SumoLogic]] tag line of "The world’s leading platform for DevSecOps"​ <== also has partnership potential ​ * [[https://​www.sumologic.com/​ | SumoLogic]] tag line of "The world’s leading platform for DevSecOps"​ <== also has partnership potential ​
 +* Manage Secrets even in Git [[https://​github.com/​bitnami-labs/​sealed-secrets | Sealed Secrets]] Encrypt your Secret into a SealedSecret,​ which is safe to store - even to a public repository. The SealedSecret can be decrypted only by the controller running in the target cluster and nobody else (not even the original author) is able to obtain the original Secret from the SealedSecret.
  
 +* [[credentials management]]
 +
 +Configuration Management:
 +* [[https://​github.com/​ManageIQ/​manageiq | ManageIq]]
 +
 +Ci/CD
 +* [[devSec Gradle Plugins]]
 == Video ==  == Video == 
  
Line 526: Line 658:
 * [[http://​themeforest.net/​item/​material-resume-cv-vcard/​13703959?​s_rank=1 | resume template * [[http://​themeforest.net/​item/​material-resume-cv-vcard/​13703959?​s_rank=1 | resume template
 ]] ]]
-* [[http://​themeforest.net/​item/​businessbox-corporate-business-template/​5180049?​WT.ac=search_thumb&​WT.oss_phrase=corporate&​WT.oss_rank=9&​WT.z_author=trendyWebStar | potential Ricston]]+
  
  
Line 581: Line 713:
  
 IBM's Bluemix ​ IBM's Bluemix ​
 +* [[IBM Cloud]]
 * [[http://​openwhisk.incubator.apache.org/​ | openwhisk]] the lambda equivalent ​ * [[http://​openwhisk.incubator.apache.org/​ | openwhisk]] the lambda equivalent ​
 * [[Api Connect]] * [[Api Connect]]
Line 586: Line 719:
 * [[App Id]] * [[App Id]]
 * [[serverless]] framework ​ * [[serverless]] framework ​
 +
 +=== Kubernates ===
 * [[kubernates]] * [[kubernates]]
 ** [[Getting Started for Development]] - with miniKube ** [[Getting Started for Development]] - with miniKube
Line 592: Line 727:
 ** [[Kubernates AWS]] ** [[Kubernates AWS]]
 ** [[Kubernates Azure]] ** [[Kubernates Azure]]
 +** [[Kubernates Ingress Controllers]] including traefik
 +** [[Kubernates Security]]
 +** [[Cloud native storage]] Rook
 +** [[Kubernates Monitoring]] including readinessProbes etc. 
 +** [[Gradle Kubernates]] ​
 +** [[Kubernates Daemonsets]]
 +** [[Kubernates Rasberry Pi]]
 +* [[Openshift]]
  
 == Google Cloud (Gcloud) == == Google Cloud (Gcloud) ==
Line 623: Line 766:
 * [[Financial Apps, Api'​s]] * [[Financial Apps, Api'​s]]
 * [[Jira Api]] * [[Jira Api]]
-* Ricston [[https://​docs.google.com/​a/​ricston.com/​spreadsheet/​ccc?​key=0AjynU6mIbKbadF9VTnpNdHZvOWU4QkdUalZwUnFXa3c&​usp=drive_web#​gid=9 | work resources]] +
-Screen share +
 * http://​www.ScreenLeap.com ​ * http://​www.ScreenLeap.com ​
 * [[nlp]] * [[nlp]]
Line 698: Line 840:
 == Rasberry Pi and Ubuntu Core ==  == Rasberry Pi and Ubuntu Core == 
 * [[Step 1 setup wireless networking]] * [[Step 1 setup wireless networking]]
-* [[Step 2 add ssh server and connect]]+* [[Step 2 add ssh server and connect]]A
  
 +== Alchemy == 
 +* [[Alchemical Tarot]]
 
home.1569938205.txt.gz · Last modified: 2019/10/01 06:56 by root
 
RSS - 200 © CrosswireDigitialMedia Ltd