Setting up development environment
This page outlines what you need to do to get a Storm development environment set up. In summary, the steps are:
- Download a Storm release , unpack it, and put the unpacked
bin/directory on your PATH - To be able to start and stop topologies on a remote cluster, put the cluster information in
~/.storm/storm.yaml
More detail on each of these steps is below.
What is a development environment?
Storm has two modes of operation: local mode and remote mode. In local mode, you can develop and test topologies completely in process on your local machine. In remote mode, you submit topologies for execution on a cluster of machines.
A Storm development environment has everything installed so that you can develop and test Storm topologies in local mode, package topologies for execution on a remote cluster, and submit/kill topologies on a remote cluster.
Let's quickly go over the relationship between your machine and a remote cluster. A Storm cluster is managed by a master node called "Nimbus". Your machine communicates with Nimbus to submit code (packaged as a jar) and topologies for execution on the cluster, and Nimbus will take care of distributing that code around the cluster and assigning workers to run your topology. Your machine uses a command line client called storm to communicate with Nimbus. The storm client is only used for remote mode; it is not used for developing and testing topologies in local mode.
Installing a Storm release locally
If you want to be able to submit topologies to a remote cluster from your machine, you should install a Storm release locally. Installing a Storm release will give you the storm client that you can use to interact with remote clusters. To install Storm locally, download a release from hereand unzip it somewhere on your computer. Then add the unpacked bin/ directory onto your PATH and make sure the bin/storm script is executable.
Installing a Storm release locally is only for interacting with remote clusters. For developing and testing topologies in local mode, it is recommended that you use Maven to include Storm as a dev dependency for your project. You can read more about using Maven for this purpose on Maven.
Starting and stopping topologies on a remote cluster
The previous step installed the storm client on your machine which is used to communicate with remote Storm clusters. Now all you have to do is tell the client which Storm cluster to talk to. To do this, all you have to do is put the host address of the master in the~/.storm/storm.yaml file. It should look something like this:
nimbus.host: "123.45.678.890"
Alternatively, if you use the storm-deploy project to provision Storm clusters on AWS, it will automatically set up your ~/.storm/storm.yaml file. You can manually attach to a Storm cluster (or switch between multiple clusters) using the "attach" command, like so:
lein run :deploy --attach --name mystormcluster
More information is on the storm-deploy wiki
come from storm wiki
相关推荐
Unit 1, Setting up Development Environment, begins by teaching you how to set up an Android development environment on your computer no matter which OS you have. You'll learn how to install Android ...
Setting up Development Environment Chapter 2. Hello World - PHP and PostgreSQL Chapter 3. CRUD Operations Chapter 4. Working with Image and Blob Data Chapter 5. Transaction Chapter 6. Stored ...
Beginning with setting up the development environment, this book will then guide you through a practical journey to build feature-rich business applications. With the aim of jumpstarting your Odoo ...
Concise explanations walk you through the tools and patterns for developing for all the mobile platforms while detailed steps walk you through setting up your development environment for each ...
The book starts with the installation of the required development environment and setting up the emulators. Then, the simplest "Hello World" app is developed step by step. In the next chapter, basics...
Starting with the architecture of the Spring Framework and setting up the key components of the Spring application development environment, you will learn the configuration of Spring Container and how...
Booth will guide you through setting up a development environment, interacting with the Angular CLI, building Hello World, and more. By the end, you’ll know how to set up templates, compose ...
Everything from an introduction to the Android ecosystem and setting up a development environment to creating and publishing Android applications is covered in depth and with technical expertise....
You'll start off by setting up your development environment, enabling you to begin writing custom code for a Drupal-powered website through PHPStorm. You will learn about configuration management and...
For more information on setting up a development environment see Contributing to JNA. If you are interested in paid support, feel free to say so on the jna-users mailing list. Most simple questions ...
Starting with an introduction to the Ionic framework to get you up and running, you will gradually move on to setting up the environment, and work through the multiple options and features available ...
Setting up the Development Environment Chapter 3. Developing Android Wear Applications Chapter 4. Developing Watch UI Chapter 5. Synchronizing Data Chapter 6. Contextual Notifications Chapter 7. ...
You start off by setting up the test development environment and gain tips on the advanced locater strategy and the effective use of the Selenium WebDriver API. After that, the use of design ...
Starting with setting up a development environment, the book moves on to utilizing a new PhoneGap command-line tool, installing plugins, and designing your application. It then moves on to concepts ...
Chapter 3 Setting Up Your Development Environment. 41 Chapter 4 Moving Toward Object‐Oriented Programming . 61 Chapter 5 Controlling the Flow of Your Program . 129 Chapter 6 Handling Exceptions and ...