Hortnworks Zeppelin Notebook for Dummies by Salil Mehendale

Hortnworks Zeppelin Notebook for Dummies by Salil Mehendale

What is Zeppelin?

A completely open web-based notebook that enables interactive data analytics

Apache Zeppelin is a new and incubating multi-purposed web-based notebook which brings data ingestion, data exploration, visualization, sharing and collaboration features to Hadoop and Spark.

WHAT ZEPPELIN DOES

Interactive browser-based notebooks enable data engineers, data analysts and data scientists to be more productive by developing, organizing, executing, and sharing data code and visualizing results without referring to the command line or needing the cluster details. Notebooks allow these users not only allow to execute but to interactively work with long workflows.  There are a number of notebooks available with Spark.

iPython remains a mature choice and great example of a data science notebook.  The Hortonworks Gallery provides an Ambari stack definition to help our customers quickly set up iPython on their Hadoop clusters. 

Apache Zeppelin is a new and upcoming web-based notebook which brings data exploration, visualization, sharing and collaboration features to Spark.   It support Python, but also a growing list of programming languages such as Scala, Hive, SparkSQL, shell and markdown.

The various languages are supported via Zeppelin language interpreters. 

Data discovery, exploration, reporting and visualization are key components of the data science workflow.  Zeppelin provides a “Modern Data Science Studio” that supports Spark and Hive out of the box.   Actually, Zeppelin supports multiple language backends which has support for a growing ecosystem of data sources.   Zeppelin’s notebooks provides interactive snippet-at-time experience to data scientist.  You can see a collection of Zeppelin notebooks in the Hortonworks  Gallery.

Also when you are done with your notebook and found some insight you want to share, you can easily create a report out of it and either print it or send it out.

Your First BOT SCRIPT by Salil Mehendale

Internet bots are computer programs that perform easy, repetitive tasks. Bots are often used in business, since they can take care of monotonous jobs quicker than an actual person could. Some bots can work on one computer while being controlled by another remote computer.

While there are seemingly endless languages for programming scripts and many types of bots to choose from, there are a few basics to follow when planning your bot and writing the script.

Get ready for creating your first BOT SCRIPT:

STEP 1

·        Choose the type of bot to create.

·        Bots can do such tasks as send out an auto-answer instant messages, search the Internet for keywords, compile research notes, or send out bulk emails.

STEP 2

·        Select the type of programming script that will be used to write the bot.

·        Just about any programming language can be used to create a bot, so it’s best to choose one that’s already familiar.

·        Examples of programming languages are C, TCL, Perl and Python.

STEP 3

·        Look up the different script commands available for the programming language of choice.

STEP 4

·        Read bot scripts written in the programming language to see how other computer programmers have written their own bot scripts.

STEP 5

·        Write the script to respond to “On” commands.

·        This means that the bot will react in a certain way to certain events.

·        For example, an instant message bot can write back to a “Hello” message from a client with, “Please hold for the next available service representative” or “Type in your troubleshooting question.”

SAMPLE BOT SCRIPT (Test highest and lowest)

TIPS & Warnings

 Start slowly. Instead of trying to create a bot that has several different functions right away, start with one function and test it. Add new functions as you get more familiar with script writing.

·        

      An alternative option to writing a script is to use a public-domain script that was written by another computer programmer, and add to it or alter it to customize it for your specific purposes. There are several websites that offer these scripts.

·        While bots can be time-savers in business, they can also slow down a computer. Running a bot is like having an additional user working from the same computer.

·        When copying a bot from an Internet source, beware of malicious software. Some bots are used to jam up computer networks and open up “backdoors,” or holes in the computer’s security system. This is how some hackers or viruses infect your computer. These types of bots can also be used to scalp tickets or increase the prices of online auctions, and using a bot for these reasons is illegal and subject to penalty.