• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

OSUPCVLab/mobile-ar-sensor-logger: Camera and inertial measurement unit (IMU) da ...

原作者: [db:作者] 来自: 网络 收藏 邀请

开源软件名称(OpenSource Name):

OSUPCVLab/mobile-ar-sensor-logger

开源软件地址(OpenSource Url):

https://github.com/OSUPCVLab/mobile-ar-sensor-logger

开源编程语言(OpenSource Language):


开源软件介绍(OpenSource Introduction):

Mobile AR Sensor (MARS) Logger

record camera frames at ~30Hz and inertial measurement unit (IMU) measurements at ~100Hz synced to one clock source on Android (API 21+) and iOS (SDK 8.0+) mobile devices.

New features

The Android app of MARS logger is upgraded in the user interface. Now the user can specify the exposure time, ISO, camera frame size, camera ID. By navigating between tabs, the user can capture videos + IMU data, or capture images of a constant focus distance. Also the tap to focus function is corrected. The app is released at here

An Android app to capture data with the fisheye camera and the IMU on tango devices, e.g., Lenovo Phab2 Pro, Asus ZenFone AR, has been released with source code at here.

Description

Android

The Android app is developed from the CameraCaptureActivity of the grafika project.

  • Camera frames are saved into H.264/MP4 videos by using the Camera2 API (setRepeatingRequest, onCaptureCompleted), OpenGL ES (GLSurfaceView and GLSurfaceView.Renderer), and MediaCodec and MediaMuxer.
  • The metadata for camera frames are saved to a csv.
  • The timestamps for each camera frame are saved to a txt.
  • Inertial data are recorded on a background HandlerThread.

iOS

The iOS app is developed from the rosywriter in objective C with iOS SDK 8.0 released by Apple.

  • Camera frames are saved into H.264/MP4 videos by using AVCaptureVideoDataOutput and AVAssetWriter.
  • Timestamps, camera projection intrinsic parameters, exposure duration of the camera frame are saved into a csv file.
  • Inertial data are saved into a csv by a background NSOperationQueue receiving data from the CMMotionManager.

For user guide, please visit the wiki.

Features

  • 25+ Hz camera frames and 100+ Hz IMU measurements for off-the-shelf smartphones priced $200+.
  • The visual and inertial data are synchronized to one clock.
  • The focal length in pixels and exposure duration are recorded.
  • Tap to lock auto focus and auto exposure so as to fix focus distance and exposure duration.

Get started

The installation, data format, recording and exporting data are explained in the following wiki pages.

Android

iOS

Citing

If you use the logger for your research, please consider citing the paper.

@INPROCEEDINGS{huai2019mars, 
author={Jianzhu {Huai} and Yujia {Zhang} and Alper {Yilmaz}}, 
booktitle={2019 IEEE SENSORS}, 
title={The mobile AR sensor logger for Android and iOS devices}, 
year={2019}, 
volume={}, 
number={}, 
pages={},
ISSN={}, 
month={Oct},}

Contributions

We always look forward to enhancing the capability and portability of MarsLogger so that it may better serve the community. Consequently, we also look forward to community contributions. If you are willing to extend help, one way is to raise an issue and discuss with the authors about how to carry out the task. J. Huai will be happy to write up the pseudocode as assistance. Even better, another way is to code up the functionality and make a pull request (in the Android or iOS submodule).

The following enhancements are on the roadmap of MarsLogger.

  1. For the Android app, record data of a variety of other sensors or modules, magnetometer, GNSS, WiFi, Bluetooth, among others. Refer to the GetSensorData app source code at here.

  2. For the iOS app, record data of a variety of other sensors or modules, magnetometer, GNSS, WiFi, Bluetooth, ArKit, among others. Refer to the ios_logger.

  3. For the Android app, support recording with multiple cameras.

  4. For the iOS app, support recording with multiple cameras.

  5. For the iOS app, migrate it to swift, refer to the swift version of rosywriter.




鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap