Brick in the Cloud

The Lego Machine Cloud Project


5 Comments

Declarative Robot Programming via Salesforce on your Mobile with Salesforce1

photo
20131119-081643.jpgThe Lego MachineCloud project has received a massive boost in the form of two great technologies from Lego and Salesforce! I’m so pleased to confirm that my test to get the Salesforce Streaming API working on the EV3 has been a raving success! This technology allows the robot to be highly responsive to commands from Salesforce, including the hugely exciting brand new Salesforce1 mobile app.

Having uploaded the required Java libraries to the brick and adapted some Java code from a previous project. I then extended the Force.com objects I created for the previous robot to create a more “declarative” programming approach. That can be driven by Command records created by the user in the latest Salesforce user web and mobile interfaces!

Streaming Commands from the Force.com Machine Cloud

robotHere you can see a screenshot of the Robot record showing a list of commands that it has executed, note the New Command button! Simply click this button and select the type of command you want, hit Save and often before the screen can even refresh the EV3 will get the streaming API event notification and perform the command! I literally lept up from my chair the first time it did this. I’ve uploaded the source code to the project to GitHub, feel free to take a look and see how its all done!

Declarative Robot Programming via your Mobile!

programI have extended the Robot and Command objects with another object called Program. This is a container for multiple Command records, allowing you to design a program in the Salesforce UI and then create a single Command record to execute that Program!

mobilecommand

Having updated my version of the Salesforce mobile app, now known as Salesforce1, i quickly found that my Command object is now also available in this application. Within a few taps my EV3 was now also responding to commands sent via my phone! Now that is a true “No Software” reality! Amazing stuff Salesforce!

Dreamforce

I’ll be bringing the robot you see in the video to Dreamforce with me next week, where I cannot wait to see what people think of this approach to programming the EV3 in the “Internet of Things Lab” session. Its a basic framework at this stage but the potential is huge for having Robot’s socialise (from all over the world!) on the Salesforce “Machine Cloud” platform. See you at Dreamforce next week!

Brief Demo Video

Advertisements


1 Comment

Programming the new Lego Mindstorms EV3!

EV3RSTORMI’ve finally got my hands on the next generation of Lego programmable bricks, the Lego Mindstorms EV3. It has a number significant improvements over the NXT shown in my previous posts. Most notably for me is the improved processor and the fact that it actually runs Linux, not only that but Lego have shared the source code to the firmware as well! Bravo Lego!

Screen Shot 2013-11-14 at 00.48.30

It has only been out a short while and already it has been embraced by the community and a surprise corporate interest from none other than Oracle themselves! I  wanted to try Java on the last brick, but read that it had a number of limitations and caveats. Not so with the EV3, Oracle have provided a fully fledge Embedded version of their JVM for use on the brick, more on this in a moment! Thank you!

photo

I also of course needed to get the brick talking to the internet, once again the EV3’s improvements gave it big step forward from the rather large third party Wifi receiver I found for the last robot. This time, its time to plug in the worlds smallest Wifi USB dongle, the Edimax EW-7811Un (note this does not work with the standard Lego software currently)! Check it out its tiny, ideal for cloud enabling robots!

Finally a Micro SD card slot gives the ability for extra storage, as well is the ability to create a bootable partition on it. Meaning you don’t have to replace the standard firmware to get started, just build an appropriately formatted and configured SD card image (not quite as easy at present as you’d imagine, but worth the effort!) and the device boots from that if installed.

lejosLogoThis is exactly how the clever developers at leJOS have provided a toolkit to run the Oracle JVM with the appropriate configuration to run regular Java code! With a little help from Juan Antonio Breña Moral and his website on EV3 programming. I was also soon up and running with a pretty slick Eclipse based devleopment environment and a deployment script taking the otherwise heavily clicky task of pushing the code to the device down to a matter of a few seconds using an Ant script. Next step Salesforce connectivity! I’d settle for nothing less than using the Salesforce Streaming API for this robot, and I was not to be disappointed…

ev3dev


7 Comments

Its alive! Lego Robot and Salesforce Chatter Demo

After a few late nights / mornings I finally got my second robot chatting with me via Salesforce Chatter! I chose to switch designs as it was easier to mount the Wifi sensor and move this robot around than the Alpha Rex. You cannot see it in the video but I was controlling it via the Chatter app on my iPhone, I took some screenshots after the video.

photo photo[1]

The NXC code I developed for this communicates to Salesforce via a custom Heroku RESTful Service. Which provides two services /command and /chat that wrap the Chatter API in something easier to code against in NXC. I’ll share the Java code for these  services in a later blog. In the meantime enjoy!

task main()
{
   SetSensorLight(S3, true);
   if (quickConnect(WB_PORT,"ssid",WB_SECURITY_WPA2,"pass"))
   {
    string lastCommand;
    while (true)
    {
     string command = quickGETHostname(WB_PORT,"brickinthecloud.herokuapp.com","/services/command");
     if (command!="") {
       TextOut(0,LCD_LINE1, "Cmd:" + command + "      " );
       if(strcmp(command, lastCommand)!=0)
       {
          string message = "Afirmative!";
          if(strcmp(command, "Status?")==0)
          {
             float volts = BatteryLevel() / 1000.0;
             message = FormatNum("Battery:%5.3f", volts);
          }
          else if(strcmp(command, "Take aim!")==0)
          {
             RotateMotor(OUT_B, 180, 180);
             RotateMotor(OUT_C, 180, 180);
          }
          else if(strcmp(command, "Fire!")==0)
          {
             RotateMotor(OUT_A, 360, 360);
          }
          else if(strcmp(command, "Light on!")==0)
          {
             SetSensorColorRed(S3);
          }
          else if(strcmp(command, "Light off!")==0)
          {
             SetSensorColorNone(S3);
          }
          string response = quickGETHostname(WB_PORT,"brickinthecloud.herokuapp.com","/services/chat?message=" + message + "&comment=true");
          TextOut(0,LCD_LINE1, "Response:" + response + "      " );
          strcpy(lastCommand, command);
       }
     }
     else {
       TextOut(0,LCD_LINE1,"GET ERROR");
     }
    }
   }
}


1 Comment

First Robot Built

I’ve completed my first build and run a few programs from the standard Lego software to test the mechanics. Its a pretty impressive peace of kit! Here are a few pictures of the standard Alpha Rex robot. With one major enhancement, can you spot it? It is capable of communicating with the internet via its fetching Wifi back pack!

photo (2)  photo  photo (1)

After doing a few tests with the backpack idea, sadly it does effect the balance of the robot, so some tweaking might be required, I’m thinking tracks….


Leave a comment

HumaRobotics Wifi Block

Key to this project is a means for the robot to communicate with the outside world on its own without the aid of a PC or MAC. Lego Mindstorms robots support Bluetooth and USB connections with a PC or Mac but lack the ability to use a Wifi network.

Enter the HumaRobotics Wifi Block! This plugs into an available sensor port on the NXT. HumaRobotics developers have also done an excellent job of integrating with the Mindstorms drag and drop programming tool, so I was able to get the Wifi Block configured to my Wifi network and thus to the internet pretty easily *.

Screen Shot 2013-02-24 at 12.25.23

There are 4 programming blocks provided in this environment, the WifiBlock Utils block allows the NXT to communicate with the Wifi Block. By dragging this onto the programming surface you can give it the usual Wifi connectivity details.

Screen Shot 2013-02-24 at 12.27.33

Once the indicator light on the block is a steady green, I was able to confirm the connection by pinging it!

photo

Screen Shot 2013-02-24 at 12.37.10

Now that I had made a connection, I was keen to start building. There are many robots that can be built with the kit. I am starting with one of the advanced ones, the Alpha Rex robot. I’ll be giving him a more appropriate name later!

* A lot easier in fact, than getting the Mindstorms software running on Mac OS 10.7. I was pleased to find a great Lego resource on the net, linked with another favourite pastime of mine, StackExchange! Lego Answers Beta.
 


2 Comments

The Lego Machine Cloud Project

I’ve always been a big fan of Lego, mainly Lego Technic. Since the introduction of Lego Mindstorms I’ve been exploring the possibilities of combining Lego Mindstorms with my current personal and professional interest in Cloud Computing.

I’m always looking for new ways to leverage Cloud based technologies, one such technology I’m working with in my professional life is Salesforce.com. This blog and project is purely recreational however. It will explore a new Cloud which Salesforce.com is inspiring…

The Machine Cloud

While attending last years Salesforce Dreamforce 2012 event in San Francisco. Marc Benioff (Salesforce.com, CEO) highlighted in his key note speech. A new form of Cloud that is taking shape around us. That of the Machine Cloud! This is the basic inspiration for this new blog!

We are all consuming Cloud services such as Twitter, Facebook, eBay, iCloud etc everyday. The Machine Cloud, expands this to the machines we use day to day. Allowing those machines to interact with Cloud services and in doing so the humans that use them as well. From jet engines to the cars we drive, machines are starting to adopt the Cloud! If at this point your maybe thinking Judgement Day. Worry not, its unlikely a Lego Robot talking to the Cloud will take over the world!

Project Aim

Fun demonstration of a Lego Robot interacting with humans via Cloud technologies, in this case the Salesforce.com Cloud.

The robot must be directly connected to the Internet and be able to transmit and receive messages over HTTP. Allowing it to communicate (or perhaps Salesforce Chatter) the status of its various sensors (and hence its environment). While also allowing me to chat with it to ask questions or give commands.

Since I will be using the Salesforce.com Force.com Cloud platform. I already have a number of Web based technologies and API’s at my disposal, as well as means to create my own if needed. As the legendary Sherlock Holmes once said, “The game is afoot!”

salesforcecoms-bold-vision robot