Volume 22 Number 5


EdgeX - the real IoT?

Linux Foundation's new internet of things/edge computing framework 'is not YAPP.' Dell-backed interoperability framework sets out to 'deliver interoperability and drive digital transformation.'

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Statoil establishes IT CoE

Center of Excellence and NOK '1 to 2 billion' investment to accelerate digital technology deployment and global leadership through 2020.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

'Digitalization,' from Harry Nyquist to the 'edge' of the internet

Neil McNaughton tires of digital, digitization, digitalization and disruption. In this back to basics tutorial, he explains how a stream of digital data is actually only a model of reality which may or may not be fit for purpose. Aligning data across the internet of things is only half the story.

You might be forgiven for thinking that today, just about every measurement is ‘digital.’ A watch shows time in digits. Music streams across the internet in digital MP3 files and so on. Although if you are a music buff, you will know a bit about err.. bit rates … and the difference between a scratchy sounding MP3 file and a CD. At the root of time and sound, indeed just about any measurement, there is the continuous ‘analog’ variation of a parameter that needs to be sampled and turned into a string of numbers. This is not quite as easy as it appears. The manner in which analog is turned into digital determines how the real world is perceived by those using the digital version. It is a good idea to understand how the conversion has been achieved before blindly treating the ‘digital twin’ as the unadulterated truth.

It is usual to speak of the digital to analog conversion process as ‘sampling.’ While this is not wrong, it only tells half the story. The process of digitizing is a process of modeling. How it is done affects how well the digital version will represent reality and how useful it will be for a particular purpose. 

Analog-to-digital conversion was invented by electronic engineers and assumes that the parameter of interest, the signal, varies in such a way that the sampling campaign can be designed to capture all significant changes in the signal. There is a big ‘gotcha’ in this approach as follows.

Suppose that the ‘signal’ to be digitized is the length of the day as judged from observations of the position of the sun. Imagine that our observer was a bit lazy and just checked the position once a day, at 12 noon. He or she might conclude that the sun never changed its position, its ‘frequency’ would be zero and its period infinite. Suppose now that the observer took a reading just a little bit more frequently, say, for the sake of argument, once every 23 hours 56 minutes. He or she would then conclude that the sun was moving slowly backwards, returning to the same position after a year! To capture the sun’s true frequency, you need to take at least two observations per day, spaced 12 hours apart. Anything below two samples per cycle gives the wrong frequency, a phenomenon known as ‘folding’ or ‘aliasing.’ For more on this you need to visit Harry Nyquist who first described the problem.

To avoid having embarrassing ‘folded’ frequencies polluting the digitized data, seismologists and engineers apply an ‘anti alias’ analog filter before sampling to remove all frequencies that would otherwise ‘fold.’ National Instruments has a good page explaining this. Incidentally, a search on NI.com for ‘Nyquist’ returns some 2,000 references! For a geophysicist, an engineer sampling the electrical output from a device on the ‘internet of things,’ frequencies higher than the fold either do not exist or are not important. High frequencies are often thought of as ‘noise.’ 

The Nyquist/folding phenomenon is not limited to the time domain. Folks who make maps from discrete point measures of topography, gravity measurement or radar altimetry should filter out the higher spatial frequencies although I’m not sure that this is always done. It’s perhaps more usual to ‘filter’ by contouring the data into a smooth representation afterwards. While this is probably not best practice, it does implicitly acknowledge that high spatial frequencies don’t exist. If, from a 100km x 100km per data point survey across the alpine chain, you contrive to contour in Mont Blanc, the Matterhorn and the Monte Rosa then you are either making things up or interjecting what is called ‘prior information.’ We will come back to ‘prior’ and ‘making things up’ in part II of this tutorial/editorial series*. 

Now what happens if frequencies above the fold are important. Consider the popular meme of equipment monitoring. Sensors on rotating equipment likely will return the same value of say oil temperature, RPM or whatever for very long time periods. Such slow variations can be captured and transmitted accurately with a low bandwidth network. But what if  the analytics tells us that a malfunction is preceded by a very high frequency event, the noise made by an oil pump blowing a gasket, or the clicking of a worn bearing as happened to me on my bike recently. To record all the data at a frequency high enough to detect such rare events would require much higher data rates that that needed to faithfully capture normal operation. If you need millisecond sampling for the extraordinary and the ordinary is happy with one sample per day you have just multiplied your bandwidth, processing and storage requirements by a zillion!

What to do in such circumstances is part of ‘edge computing,’ the subject of this month’s lead. Transient events can be recorded locally at a suitably high frequency in a local loop. If a value goes above some threshold, the loop containing the data can be sent over the wire. This implies of course more local ‘smarts’ at the edge and likely across the network too. Much more sophisticated scenarios can be envisaged, with machine learnings (about bearing failure noise patterns and such) deployed ‘at the edge’ so that all that comes over the wire is a succinct ‘crank bearing fault’ message (we are assuming the connected bike here). 

Note however that the more smarts in your edge processing, the less access you have to real ‘internet of things’ data. Combine this with kit (sensors and smarts) from multiple vendors each with their own ‘land grab’ smarts and you see why the Linux Foundation’s idea is a necessary but probably not sufficient condition for interoperability. The problem is not just about aligning data protocols, it is also, and more profoundly, about aligning models of reality. A harder, if not impossible task!

* but likely not for the next issue.

@neilmcn


Oil IT Journal interview, Ken Evans SAP

SAP VP and global head of oil and gas on the digital transformation, automation and how collaboration with GE is breaking down engineering/ERP silos. Evans thinks that realizing blockchainís potential needs more R&D. SAP announces a new 'digital transformation navigator.'

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

SAP, StromDAO, EU/STOA, Stanford's Energy Web Foundation

Interest in blockchain reaches fever pitch in EU and US.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Lux scrapes knowledge from SPE's OnePetro resource

Graph analysis of co-authored papers shows collaboration of service companies and operators.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

NIST floats Industrial Ontologies Foundry

Multiple, overlapping domain ontologies would benefit from an upper level 'foundry' approach.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

MPI, the 'Once and future king' of parallel computing

Rice University presentation celebrates 25 years of open standard for HPC.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

IOGP clarifies stance on standards

Recent developments in standards space. JIP33 and 'Standards solution' announced.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Software, hardware short takes ...

Weatherford's IoT-based production optimization. AspenOne V10. PetroWeb EnterpriseDB. Petro Niche/Ninja. Dell's ArcGIS desktop appliance. Geophysical Insights' AASPI/Paradise. tNavigator on GPUs. OpenFlow Suite 2017. Global Mapper for Android. SciGraph linked open data resource.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

2017 SAS Global Forum, Orlando

Devon on Hadoop-based deep learning for downhole video analysis. SAS uses FFT to perform asset analytics in real time. Petronas on production analytics-based forecasting. SAS OptModel optimizes Middle East oil products distribution network.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

PNEC E&P Data and Information Management 2017

Teradata's historical perspective on analytics. Shell's 'ESSA' data automation. Total deploys Resqml. PPDM WIAW-as-an-ontology. Energistics' Witsml 2.0. ConocoPhillips on AI and the auditable data pipeline. Devon's 'Sifter' well log manager. Statoil's 4D seismic data lake. ExxonMobil on Agile/DevOps. Huvr on the drone 'data dilemma.' EP Energy on 'killing' traditional data management.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Folks, facts, orgs ...

Aveva, Baker Hughes, Barco, BCCK, Borets, Transocean, Hunter Group, Enerflex, Energy Pipelines CRC, Enservco, Geological Society, Halliburton, Hexagon, Ikon Science, Lloyd's Register, Michael Baker International, Protiviti Digital, Savanna, Schlumberger, Spectris, ST9 Gas+Oil, Weir, Williams, W&T Offshore, Alberta Energy.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Done deals

Mocana, GE Ventures, Hunter/Badger, Dwellop, Hexagon, MSC Software, Flotek, National Oilwell Varco, Bruel & Kjaer Vibro, Setpoint.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Going, going ... green

Baker Institute on cost and risk of green. Energy Futures Lab announced.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Patent potpourri

Vesmir's smart depopulation. WesternGeco/ION settlement. IBM gives up 'stupid' patent.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Siemens MindSphere IoT platform

KeepSecure app. AWS/Bluvizion partnership. MindSphere Rockect Club. Plug and play MindConnect.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Cushing upstream energy income index quits!

Bankruptcies, de-listings cause MLP tracker to be terminated.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Sales, deployments, partnerships

Commvault, IFS, Intergraph, Microsoft, KBR, IBM, Xvision, Cegal, Patrick Connolly Associates, ABB, IBM, OSIsoft, Software AG, QED-I, Barco, HPE, Capgemini, IBM, Kongsberg, Stress Engineering, Mitsubishi, Orbital Gas Systems, Petrosoft, SAP, TechnipFMC, TrendMiner, Wex Card, Wood Group.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Standards stuff

Troika's free SEG checkers. Energy Web Foundation. PPDM Compliance for Target. OPC UA .NET stack. C++ coding standard. OGC Geoscience standard. POSC/Caesar ISO15926 pump lifecycle. XBRL Assertion Sets. IFRS pocket guide. ETSI's SmartM2M IoT reference ontology.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Cyber security round-up

Ponemon Institute, NIST, PAS, BSI, Software Engineering Institute, Rand, Red Hat, Leidos, W3C, Owl Computing, IBM, Atos, Siemens.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Chemical Safety Board investigates fatal Firestone explosion

Luminent and CartoPac technology deploys to site of leaking natural gas flow line.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Bluefin SAP BW/4 Hana for Noble Drilling

Proof-of-concept deployment of drillers data warehouse in the cloud.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Data management matchup - miners vs. upstream

Datum360 blogger opines that oil and gas leads the field in data management.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Floktek signs 'cognitive' reservoir deal as suit dropped

FracMax fracas finished. IBM Watson Explorer deployed in Reservoir Cognitive Consultant.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

MSC Software simulates Pioneer's rigs

ADAMS multi-body dynamics simulator tuned with real world drilling data.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.

Fiber optic sensing association announced

New industry body to promote emerging technology with technical library.

Click here if you would like to receive a complimentary copy. This offer is discretionary and limited to one article per month for non-subscribers to Oil IT Journal.