Building a Pioneering AR Product for Construction

Augmented reality has finally hit the construction industry not as a gimmick concept but as a real tool. Spectar is a cloud platform with applications for both HoloLens generations that Blackbird helped to develop. Specatar solutions enable BIM teams to upload their design docs to Spectar Cloud and almost immediately see their designs live at 1:1 scale on the job site.

The Challenge

Spectar team is fully focused on making the future of construction available today. However, the limitations of nowadays AR tech don't allow doing everything as wanted. BIM models might hold information about a huge skyscraper with posts the communications, and Microsoft HoloLens isn’t able to digest it posts on its own. Plus, the construction never was a one-man job: collaboration is a big part of it.

Outcomes

Blackbird developed Spectar Cloud. The web application meant to handle BIM models, model versioning, and to provide a comprehensive environment that connects BIM engineers and field workers. Any of the existing workflows like Revit, AutoCAD, Navis are supported. All BIM models can now be carefully organized by projects, versions, also converted, and automatically synced with HoloLens smartglasses.

Impact

Spectar is currently used by large construction companies on the West Coast of the United States. They already used it on multiple construction sites. However, the most publicly disclosed project is PUBG Cave in the game developer HQ. The builder had worn glasses, launched Spectar app, and built the Cave with no referring to paper blueprints, and no delays on multi-tool measurements. That simple!

“I could probably go into sales for you. It's incredible. Thanks for the great service.”

Anthony, CTO of Spectar.io
About the client11-50 employeesHQ Los Angeles, USAClient since 2018 | AR and ConstructionSMBs currently
Industry and verticalsAR & VRBIM Engineering firmsCommercial, industrialand residential developers

A great start

At the time the client told us about their development needs, they already had a nicely working prototype of their HoloLens application. Their on-site team did well on it. However, their brainwidth was fully loaded with further development of AR application.

HoloLens application is a big part of their software solutions. Augmented reality is the innovation that they worked hard to bring to the entire construction industry. However, in order to make this innovation working smoothly for the majority, there were other demands to address. Among them was a clear request in other supportive software solutions including the cloud ones.

You simply will not be able to quickly build something similar to Spectar SaaS products by utilizing market-available 3rd party solutions.

Straight from the beginning, Spectar managers made a decision that they need a reliable partner to whom they could entirely outsource product development as a turnkey service. Fully managed IT services model was chosen as an obvious and the most suitable engagement choice. It remains so nowadays.

We started small as a group of 2 engineers, 1 system architect and 1 QA dived straight to working on Spectar Cloud.

Spectar Cloud is the supportive solution meant to be that perfect link between in-office employees, BIM engineers and field workers on a construction site. Among other important features are such things as project organization and management; BIM files storing and converting for HoloLens usage; easy version history management for uploaded BIM models; and, of course, synchronization with HoloLens smartglasses used on a jobsite.

The application version for HoloLens 2 provides even more perks. For instance, it supports large BIM models and multiple model overlay. We did a very custom BIM model convertor that others could only dream about. That’s the most pioneering part of the things we accomplished here.

In addition to that Spectar Cloud was made to support multiple end-users' organization roles, and to provide a clear way to make payments and control customers' subscriptions.

That what Spectar Cloud eventually become nowadays, after we had started working on it. Early versions of the cloud app have no clear role and payment management, not posts BIM files were supported, and the general project organization logic was lacking lots of good stuff.

Nevertheless, Blackbirders hand-by-hand with Spectar team overcame a lot of other technical obstacles and limitations. Especially the ones related to developing native applications for Microsoft HoloLens of both generations.

Single Spectar cloud to support all HoloLens generations

It might not sound like a big achievement but it’s really a tremendous one.

You simply will not be able to quickly build something similar to Spectar SaaS products by utilizing market-available 3rd party solutions (true for 2017-2021). You’ll be stuck on BIM model conversion and processing stage. Let us explain to you the whole picture and the product story really quickly.

Anthony, Spectar CTO, assembled the first prototype which was warmly welcomed by big construction market players. However, the early prototype handled plain GLB models.

HoloLens was chosen by Spectar team as the best hardware and software platform that meets posts the industry requirements. Especially due to its promising easiness of further product certification for field use. You may point that there are Magic Leap goggles but they are not much suitable for professionals on a construction site (for inside office only). In addition to that, it’s not a secret that enterprises are heavily using Microsoft products.

So everything above laid out the foundation of the future technology stack for Spectar augmented reality software for construction.

We created BIM model conversion and processing microservise with its own REST API that others could only dream about.

Spectar team made a decision to trust Blackbird as their own on-site team. We had a green light to plan and implement the application architecture of our choice

Microservice architecture was chosen from the beginning. However, as we moved forward we managed to change a certain app service providers. Eventually, we decide not to build the SaaS product entirely dependable from Microsoft App Services.

We are using a lot of Azure products because they really do the job for the particular enterprise AR software we are working on. However, the back end for the Spectar SaaS product was written on Java and the front end on React. Oh, and the market best BIM model converter utilizes Python with some Java-based libraries. You will learn more about the converter later in this section.

Azure Virtual Machines service was used to deploy posts the microservices for the early first version of the back end. The further ones were deployed on Docker with Kubernetes (K8s) Container Orchestration. Meanwhile, the front end was and is still run on Microsoft Azure Web App for Containers.

Such an architecture planning allows us to quickly port Spectar AR application to any smartglasses with no headache. It means we are not limited to just Microsoft HoloLens AR smartglasses, and open for any promising alternative that would hit a market.

Nevertheless, posts the above are not sci-fi technologies but BIM model converter we developed entirely from the ground up is that tech miracle. It handles posts the industry popular workflows like Revit, AutoCAD, Navis.

By the way, Spectar Cloud supported IFC model format solely in its early versions. If you are from the industry, you know that whatever SaaS product you are looking to build, you’ll have to use Autodesk Forge APIs and services. Especially, you’ll be forced to use BIM 360 API as there are no other reliable 3rd party alternatives available (true for 2017-2021). However, the BIM conversion done via Autodesk services wasn’t the one we need.

Unlike other large outsourcing players, we do not practice up-selling our clients to develop their own custom solutions while the market is full of solid and affordable solutions that can be quickly used. It was a rare case when such a custom solution was a necessity not a luxury.

Not limited to Microsoft HoloLens smartglasses. The product architecture allows us to quickly port Spectar AR application to any promising Microsoft alternatives.

So we created such BIM model conversion and processing microservise, and even developed REST API for it. We promptly added support of posts HoloLens 2 capabilities at the beginning of 2020. IFC to GLB is also both fast and smooth.

The latest BIM model conversion and processing microservise able to digest large models with multiple model overlays built-in. So you see your 3D models live with posts the details and labels as instantly as you move around a jobsite no matter in what direction.

Spectar Cloud UX and UI was also redesigned by Blackbird team, so Spectar clients could enjoy a superior software not only on HoloLens but in their web browsers too.

Since we cooperate as a turnkey fully managed IT services, we also took care of such internal operations flows as customer onboarding and support, subscription management, etc. Spectar sales and customer support teams have their own tools to take care of posts important business operations.

Ongoing outcomes

Spectar and Blackbirders made a holistic effort to build a truly pioneering product and keep doing it side-by-side. Moreover, Spectar management decided to grow the off-site team. It’s more than 10 Blackbirders push the boundaries alongside Spectar crew.

Blackbird joined the development of Spectar application for HoloLens 2 in addition to furthers development and maintenance of Spectar Cloud app suite and HoloLens 1 app.

People who made it a reality
Yurii D.CEO
Dmytrii S.Account Manager
Oleksandr L.Senior Developer
Gleb G.Senior Developer
Anastasiia S.Senior QA
Anastasiia IlinaSenior Java Engineer

Have a similar project or feel like we have what it takes to help you out?