Robotics Software Engineer - Japan
Currently I am working at SEQSENSE / シークセンス writing software for SQ2 series of security robot. Primarily the robot acts as an autonomous security camera that carries out scheduled, pre-defined patrols each day in large office buildings. The types of buildings our robots operate in all have dedicated security centres, so there robots are used to complement the jobs of the already-present security personnel.
SQ2 uses a cluster of three 2D laser scanners which are rotated on a turntable to perceive the surrounding environment and navigate. Additionally it uses four wide-angled cameras placed around the body for image capture. Data is continuously streamed to a web-based interface which allows security guards to review patrols and see what the robot is doing at any time. The robot is capable of self-docking with it's battery charger when required and can also use specific elevators to enable multi-floor patrols.
My work is mainly focused on object detection and tracking for a safety feature which is currently still under development. Previously I worked on a mapping system used to generate the 3D maps used for navigation. Working here has taught me about software containerisation, continuous integration, and how different cultures think about development.
Robotics Post-Doctoral Researcher - New Zealand
Between 2015-2018 I was a post-doctoral researcher on a kiwifruit orchard robotics project. The project was a collaboration between two universities, a government research institution and a private robotics company and was government funded. As a team of about 12 people, we developed robotics for autonomously pollinating and harvesting kiwifruit as well as a multi-purpose platform to which we could attach the pollinating and harvesting robots.
My work primarily focused on the development of the multi-purpose platform. The platform was a hybrid petrol-electric vehicle capable of autonomous row-following in kiwifruit orchards by way of lidar based sensing of the orchard's structure. It could drive fully electrically by way of six electric motor/gearbox units while providing AC and DC power outputs any mounted robotic systems. Also, it had a carrying capacity of 1 tonne on its payload space, plus extra capacity to carry kiwifruit in the space between the rear wheels.
The kiwifruit harvesting and pollinating units are quite spectacular to watch. The harvester could identify kiwifruit in 3D using stereo cameras and artificial neural network, decide in which order to harvest the kiwifruit (to minimise damage to neighboring fruit), then instruct the custom robotic harvesting arms to take the fruit. You can see it working in the video below.
The pollinator could use the same cameras and neural-networks to identify flowers in 3D and then shoot pollen solution at flowers as the vehicle drove underneath. The time-of-flight of the pollen solution was calculated for each shot so the pollen would hit the flower while the vehicle was in motion. Unfortunately there is no publicly available video of this robot to show, but this animation shows the general process.
Overall, my role was quite varied and involved mechanical design and fabrication, electrical design and fitment, as well as a variety software development. Software included custom computer-vision algorithms to detect kiwifruit, lidar processing for autonomous navigation, custom firmware to control motor drivers, as well as low-level software for safety. Looking back at this work, it was an amazing experience and opened my eyes to the possibilities of robotics in the agriculture industry.
- Mark Hedley Jones, Jamie Bell, Daniel Dredge, Matthew Seabright, Alistair Scarfe, Mike Duke, Bruce MacDonald (2019). Design and Testing of a Heavy-Duty Platform for Autonomous Navigation in Kiwifruit Orchards. Biosystems Engineering
- Henry Williams, Mahla Nejati, Salome Hussein, Nicky Penhall, Jong Yoon Lim, Mark Hedley Jones, Jamie Bell, Ho Seok Ahn, Stuart Bradley, Peter Schaare, Paul Martinsen, Mohammad Alomar, Purak Patel, Matthew Seabright, Mike Duke, Alistair Scarfe, Bruce MacDonald (2019). Autonomous pollination of individual kiwifruit flowers: Toward a robotic kiwifruit pollinator. Journal of Field Robotics.
- Henry Williams, Canaan Ting, Mahla Nejati, Mark Hedley Jones, Nicky Penhall, JongYoon Lim, Matthew Seabright, Jamie Bell, Ho Seok Ahn, Alistair Scarfe, Mike Duke, and Bruce MacDonald (2019). Improvements to and large‐scale evaluation of a robotic kiwifruit harvester. Journal of Field Robotics
- Henry A.M. Williams, Mark H. Jones, Mahla Nejati, Matthew J. Seabright, Jamie Bell, Nicky D. Penhall, Josh J. Barnett, Mike D. Duke, Alistair J. Scarfe, Ho Seok Ahn, JongYoon Lim, Bruce A. MacDonald (2019). Robotic kiwifruit harvesting using machine vision, convolutional neural networks, and robotic arms. Biosystems Engineering
- Jones, M H, Seabright, M, Barnett, J, Neshausen, G, Duke, M, & Scarfe, A. (2017). An Electrically Driven, Computer Controlled Robotics Platform for Orchard Use. Poster Presentation at The International Tri-Conference for Precision Agriculture in 2017, Hamilton, New Zealand
- Seabright, M, Jones, M H, Williams, H, Nejati, M, Barnett, J, Duke, M, … MacDonald, B. (2017). Robotic harvesting of kiwifruit. Poster Presentation at The International Tri-Conference for Precision Agriculture in 2017, Hamilton, New Zealand
- Jones, M. H. (2016). The Electrical Properties of Interfacial Double Layers (Thesis, Doctor of Philosophy (PhD)). University of Waikato, Hamilton, New Zealand.
- Hicks, B. J., Jones, M. H., de Villiers, J. E., & Ling, N. (2015). Use of Electrofishing for Capturing Invasive Fish. In K. J. Collier & N. P. J. Grainger (Eds.), New Zealand Invasive Fish Management Handbook (pp. 72–79). Hamilton, New Zealand: Lake Ecosystem Restoration New Zealand (LERNZ) & Department of Conservation.
- Jones, M. H., & Scott, J. B. (2014). Feasibility of Harvesting Power To Run A Domestic Water Meter Using Streaming Cell Technology. Presented at the 21st Electronics New Zealand Conference (ENZCon), 20 - 21 Nov 2014, Hamilton, New Zealand.
- Jones, M. H., & Scott, J. B. (2014). Scaling of Electrode-Electrolyte Interface Model Parameters In Phosphate Buffered Saline. IEEE Transactions on Biomedical Circuits and Systems, 9(3), 441–448.
- Jones, M.H. & Scott, J.B. (2011). The energy efficiency of 8-bit low-power microcontrollers. In Proceedings of the 18th Electronics New Zealand Conference, ENZCON 2011, Massey University, Palmerston North, 21-22 November 2011, pp. 87-90.
- Jones, M. H. & Scott, J. (2011). Design study of a thermocouple power sensor as a monolithic fin-line. Paper presented at the 77th ARFTG Microwave Measurement Conference. Baltimore, Maryland; June 10 2011.
- Jones, M. H. (2010). Millimetre Wave Power Measurement (Thesis, Master of Engineering (ME)). The University of Waikato, Hamilton, New Zealand.
For more details on my work or research experience, my CV can be downloaded by clicking the image below.
If you're interested in adapting this document for yourself, download the source code.