Good news Feature Manipulation Engine (FME) users! If you want to crunch your GIS data in BigQuery, it’s now possible with FME available in the Google Cloud Marketplace. This announcement is a gamechanger as it means that geospatial data processing power can now be performed at a previously unmatched level.
GIS professionals are really excited about this news for two main reasons:
The first thing you need to acknowledge when answering this question is that there are a myriad of GIS file types and projections that exist. Storing these in a data warehouse means that you need to transform the data type and it’s projection into the native projection of the data warehouse you’ve chosen (this is why you’d use FME).
There are two key things to note if you choose to store your GIS data in BigQuery:
In short - the former cumbersome process just got a lot easier and quicker.
If you want to get started using FME (Desktop & Server) and BigQuery via a pre-installed virtual machine (VM) on Google Cloud, you need to follow these steps:
The great news is that if you’re already using FME in your organisation, when you access FME in the Google Cloud Marketplace you’ll be prompted to login to your FME account. If you don’t have FME, sign up for a free trial when you register for an account.
If you don’t have a Google Cloud account in your organisation - Google is offering USD $300 in credits so that you can get started querying your data in BigQuery. This is great if you want to test the integration out or simply see what’s possible with BigQuery.
Something important to note is that you still don’t need to remove your data from the Google Cloud Platform to create beautiful maps using the data you’ve ingested via FME. As part of their ongoing support for large-scale GIS functionality on the platform, Google has partnered with CARTO - a partner of NGIS - to enable users to connect their BigQuery tables directly into CARTO. From here, you can perform spatial analyses and create truly impactful maps.
All you need to do is search for CARTO on the Google Cloud Marketplace, login or register for a trial CARTO account.
NGIS has partnered with these organisations to help arrange your licensing needs:
NGIS has also recently released a report comparing the Google Cloud BigQuery and Snowflake for storing and processing GIS data. It’s free to view and you can access it via this link.
You can chat with our team if you need further information.
About the author: Sarah Butler
Sarah is the Marketing Manager at the NGIS Australia Group. The group consists of location focused companies including NGIS Australia, Winyama, Liveli and EO Data Science.