Links-Programming - Azure, Mongodb, Spark Apache, devops and databricks

spark apache - 

https://spark.apache.org/docs/latest/api/python/getting_started/index.html

databricks:

https://www.databricks.com

https://www.databricks.com/solutions/industries/retail-industry-solutions

Top Databricks Data Intelligence Platform Alternatives
  • SQL Server.
  • MongoDB Atlas.
  • Oracle Database.
  • Teradata VantageCloud.
  • Amazon Redshift.
  • SAP HANA Cloud.
  • Google BigQuery.
  • Snowflake Data Cloud.


What is Databricks used for?
Databricks is an industry-leading, cloud-based data engineering tool used for processing and transforming massive quantities of data and exploring the data through machine learning models. Recently added to Azure, it's the latest big data tool for the Microsoft cloud.
https://azure.microsoft.com/en-us

Azure

 is a cloud computing platform
What is Azure?
The Azure cloud platform is more than 200 products and cloud services designed to help you bring new solutions to life—to solve today's challenges and create the future. Build, run, and manage applications across multiple clouds, on-premises, and at the edge, with the tools and frameworks of your choice.

Azure Data Lake

DescriptionAzure Data Lake is a scalable data storage and analytics service. The service is hosted in Azure, Microsoft's public cloud. Wikipedia

MongoDB Atlas Data Lake

An integrated analytics data store that won't impact the performance of your application.

ETL
ETL code is the set of scripts or programs that perform the data extraction, transformation, and loading tasks. ETL documentation is the collection of information that describes the data sources, the data flow, the data quality, the business rules, and the expected outcomes of the ETL process.

Devops






Comments

Post a Comment

Popular posts from this blog

PHP MYSQL notes

PHP Beginner PHP Array Loop Function Pre-Def variable Session Read Write File CRUD Advanced PHP PHP MySQL PHP MyAdmin PHP MySQL Notes Other course Python Beginner Intermediate Advanced Pro python-hosting React Links General JS PHP Programming Python C++ Stuff TR: Create DB Collation Supported language: gözönünde bulundur Most common: UTF-general-cı Türkçe: ISO 8859-9 (latin5) windows 1254 utf-8 çok daha iyi ama dezavantaj daha çok byte Data Type Int - collation boş - size boş String - bu field her zaman  Char olmalı-çünkü =255 kar
Read more

Programming- AI, machine learning

< JS C C++ Python >< coding Robotics CNC > < Robotics CNC Links > < CNC >< CNC tutorial > < 3d printing >< Azure MongoDB Spark > < AI Pytorch > < Ship building > < GIT >      Data science R For statistical computing Stat modeling data analysis clustering time series forecasting OOP Python, it has a graph and stat packagees Matpotlib Numpy ScipPy Deep Learning packages TensorFlow PyTorch Keras SQL relational db NoSQL; non relational, distributed db MongoDB, Radis, Cassandra Hadoop: Big data; management and storage of huge data It is a storage of Big Data Open source software It uses distributed storage system called Map Reduce PAckages in Hadoop: Pig, Hive, HBase Tableau Data visualization software Specialized in graphical analysis if data Interactive visualisation and dashboards: treemaps, histograms, Box Plots It connects with spreadsheets, DB and cloud Weko For getting familiar with ML in action Open source it was GUI (no co
Read more

Programming -- JS, C, C++, Python

Image
 < JS C C++ Python >< coding Robotics CNC > < Robotics CNC Links > < CNC >< CNC tutorial > < 3d printing >< Azure MongoDB Spark > < AI Pytorch > < Ship building > < GIT >   programming language history  This is taken from somewhere that I have not taken a note. It is a real good work. It describes the root for the languages. I have found this schema on the internet around 2000. And at this time visual basic did not evolved to something new. but got mixed with C# and all other possible language forming .NET which was really good (under c# this is written).  Second note for this schema, although internet was there (since 70`s?) the sofware related to internet did not really show up, and were not really strong enough in the market. The revolutionising of the internet ability changed this schema radically. While there was few programming language at the 90`s, on 2010 there were I guess more than 100 in the market which were active
Read more