Smart Data Flow

Like in any other agriculture business, the livestock industry relies on timely and accurate data. With wearable animal sensors, feeding systems, and imaging technologies increasing in popularity, the volume of data generated daily has grown exponentially. While these precision farming technologies are indispensable for farm operations, accessing raw data for research purposes presents a significant challenge. Many systems provide aggregated or localized data, requiring researchers to develop custom solutions for remote data extraction.

Let me share a project I worked in 2023 to automate remote data collection from a dairy farm using our innovative Smart Data Flow solution with a custom device tailored to our client's need.

Feed efficiency is a key focus in livestock management, and automated feeding systems like the RIC2Discover from Hokofarm Group (formerly known as Insentec BV) play a vital role in recording individual feed intakes on large operations with minimal maintenance. The RIC2Discover is used on different kinds of research projects, such as feeding efficiency and animal welfare, given its exceptional accuracy. While the system generates comprehensive raw data in structured comma-delimited files, these files are only accessible locally*, posing a challenge for research projects requiring remote data access.

As part of a national research project, Lactanet partnered with Sunalta Farms, a dairy farm in Alberta, Canada, to capture daily data to improve dairy cattle genetics. Lactanet engaged me for a solution to automate the extraction and secure transfer of this data to a remote server, while ensuring reliability, accuracy, and data integrity for their research project.

*Hokofarm has recently developed an API for remote data collection, which I plan to share more details about it on a separate article!

At the core of the solution is a custom-built edge device, housed in an IP67 waterproof enclosure engineered to withstand wet and dusty barn environments. This versatile device features both wireless and wired internet connectivity and is powered via PoE+ (Power over Ethernet) for streamlined cabling management. For farms without a PoE+ network, such as our client's dairy farm, we provide a PoE+ injector along with an easy-to-follow installation diagram included in the user's manual.

Automating Data Collection, Proactive Monitoring and Alerts

The product was delivered pre-configured with specialized software tailored to seamlessly interface with the RIC2Discover system and automate data collection on a predefined schedule.

Designed for simplicity, this devices requires zero configuration on-site — they just plugged it in and it was ready to go. Automatic recovery mechanisms ensure data integrity by queuing and resuming file transfers in the event of network disruptions. Because cyber security is paramount, this device employs robust end-to-end encryption protocols to securely transmit data to authorized servers.

A built-in notification system continuously monitors the data pipeline and transfer statuses. It promptly alerts any anomalies, such as system unavailability or unexpected data deviations, enabling swift troubleshooting and resolution.

Data pipeline is comprehensively logged from data source extraction to transfer to a remote server.

Seamless data integration with the RIC2Discover system is just one example. Our Smart Data Flow solution provides reliable and secure research data collection tailored to the agricultural sector. By leveraging automation, strong security protocols, and user-friendly setup, we empower clients to harness the full potential of their data assets.

Reach out and let's discuss how we can tailor a solution to meet your needs.