Were used to hearing that AI and machine learning is hopelessly complex, impossible to implement quickly, and that if you want to get on board the machine learning bandwagon youll need to invest heavily in PhDs, specialists and expensive experts. <\/p>\n
This way of thinking is simplistic and behind the times: machine learning is a broad set of technologies, and over the past few months and years there have been huge strides in making machine learnings benefits much more accessible to startups, scale ups and lone developers alike. <\/p>\n
Over the past few months Ive spent a great deal of time investigating, learning about and iterating on a number of different machine learning technologies to take advantage of the vast quantities of time series data we have about infrastructure performance from my companys product. <\/p>\n
Were collecting billions of metrics every data from hundreds of thousands of systems, all of which can be used to understand patterns and make future predictions. Read on for some easy, actionable advice on how to get started from scratch with machine learning its easier than you think! <\/p>\n
Google made headlines in 2015 by open-sourcing TensorFlow, their internal AI and machine learning framework. Released as an open source project, TensorFlow is following the same strategy as Kubernetes provide such a good product that it becomes the industry standard, and offer a hosted, managed cloud version for those who dont want to maintain it themselves. <\/p>\n
You can run TensorFlow workloads yourself but Googles Cloud Machine Learning Platform offers a much more optimised version, running on proprietary TensorFlow Processing Unit chipsets. The strategy is all about making Google Cloud the best choice for these jobs. <\/p>\n
However, popularity can be deceptive and based on my personal experience TensorFlow is often not the best solution for startups and small companies. TensorFlow is great in that you get a high degree of control over your project but that control comes at a cost. TensorFlow is a framework, and weve found it requires significant data science knowledge and a lot of trial and error in building, iterating and improving your models. <\/p>\n
Its not a toolset you should pick up if youre after easy results or plug-and-play functionality. Unless youre a big corporation (which were not) or have the budgets to hire data scientists to get into model development, it might be tricky to secure enough budget to invest in TensorFlow from the start, so youd be much better trying more simplistic managed solutions first. <\/p>\n
For companies just starting out, the best place to begin is looking at the managed service solutions from the likes of Amazon, Microsoft and Google. These solutions are much more accessible to generalist teams, and companies that use them get the benefit of vendors updating them and improving service over time. Indeed, your own datasets help to improve the models! <\/p>\n
This is because the larger the training data set, the more accurate the models can be. Anyone can play with theoretical models but the truly interesting work comes out of having real data, and this is an advantage the big players have even before they add your data into the mix. <\/p>\n
Weve found that Amazon Machine Learning is a great place to start. AML differs from TensorFlow in a number of ways: with TensorFlow, you build your own models and can then execute them against your datasets wherever you like whereas AML requires you upload your dataset to Amazon then use their API to execute queries. The downside is you dont get to control the models and cant see into the workings of the system you rely on Amazon to get it right. This plug and play type approach but is less customised and flexible, so you may end up needing replacing it with something more specialist in the future. <\/p>\n
If you need a very particular type of functionality detecting items in a video, speech to text or translation, then there are specialist services from all the cloud providers. These services use machine learning behind the scenes, but you dont need to think about it send over the item for analysis and get the results through an API. These APIs are quite specific and so if they do a good job, you can just leave them to get on with it. Its unlikely youll want to customise them enough to make it worth starting from scratch. <\/p>\n
Outside of the big three cloud providers, there are a host of technology startups including Algorthmia, BigML and MLJar aiming to offer machine learning through an API or SaaS application. <\/p>\n
Ive seen many companies make the mistake of rushing into machine learning without having a clear use case in mind, and this is a significant error. There are robust ecosystems around each of the above MLaaS platforms, and so youll need to have awareness of the APIs available to you. Tools like Amazon Polly (text to speech) or the Google Cloud Video Intelligence API deliver specialist functionality without requiring a high degree of knowledge as a prerequisite. <\/p>\n
Since they are offered as an API, you can mix and match across providers and even test which does a better job where the service is the same. Most people will probably stick with the cloud platform the rest of their infrastructure is hosted on, but thats not always necessary (data transfer cost and latency may become an issue once you hit scale though). <\/p>\n
At my company, weve been migrating from IBM Softlayer to Google Cloud and the data transfer fees of (encrypted) traffic across the internet is part of the total cost consideration, and an incentive to complete the move quickly! Once its all within Googles network then the lower (or zero) data fees apply when using their services, and Google is widely considered to have well designed machine learning capabilities. <\/p>\n
Ive found the advantage of using machine learning as a service APIs is that any developer can pick them up and start playing. Serious machine learning with TensorFlow requires a lot of time and real data science knowledge, which may be worth investing in over the long term. However, to get something up and running quickly and test the value proposition to your users, there are a variety of options. <\/p>\n
Ive had a lot of fun testing out the different machine learning APIs and solutions out there, and this element of fun and discovery makes it much easier to lead a team on a small exploratory project. Ive also found that implementing something like Googles 20 percent time, or even an internal hackathon could also be a good opportunity to get everyone focused on building an initial prototype. <\/p>\n
Machine learning is a very over-hyped set of technologies its currently ranked by Gartner as a buzzword, at the very top of their peak of inflated expectations. However theres a vibrant set of technologies under this umbrella term, and you dont necessarily need to have a highly-specialised workforce to take advantage of them. Start small, use the managed services provided by the big tech firms, and youll be surprised by how far you can go. <\/p>\n
Read next: 5 Facebook tips and tricks to make your life easier <\/p>\n
<\/p>\n
Follow this link: <\/p>\n
You don't need to be an expert to integrate AI in your startup - TNW<\/a><\/p>\n","protected":false},"excerpt":{"rendered":" Were used to hearing that AI and machine learning is hopelessly complex, impossible to implement quickly, and that if you want to get on board the machine learning bandwagon youll need to invest heavily in PhDs, specialists and expensive experts. This way of thinking is simplistic and behind the times: machine learning is a broad set of technologies, and over the past few months and years there have been huge strides in making machine learnings benefits much more accessible to startups, scale ups and lone developers alike. Over the past few months Ive spent a great deal of time investigating, learning about and iterating on a number of different machine learning technologies to take advantage of the vast quantities of time series data we have about infrastructure performance from my companys product Continue reading