MegFlow

Features

基于 async-std[features=tokio1] 的高效异步运行时调度器
简洁的基于 toml 的建图描述格式
支持静态、动态、共享子图
支持 Rust/Python多语言共存
支持资源管理（多层级跨任务共享）
支持异常处理（异常任务会终止所在静态图）
支持 demux/reorder/transform 等通用函数式组件
Python 插件内置有栈协程，不依赖 asyncio
基础测试工具，支持插件沙盒，用于单测插件

HowTo

how to build with docker
how to build from source
how to pack Python .whl
how to add my service
how to add plugins
how to optimize and debug
how to contribute
FAQ

Current Support List

系统环境	支持情况
Windows 10 WSL ubuntu18.04	✔️
x86 Ubuntu16.04 有 GPU	✔️
x86 Ubuntu18.04 无 GPU	✔️
x86 macos	✔️
ARM	/

Python 版本	支持情况
3.6	✔️
3.7	✔️
3.8	✔️
3.9	/

Built-in Applications

猫猫围栏
电梯电动车报警

Coming Soon

进程级别的节点、子图支持
插件自动化测试部署
调试工具，建图实时预览 profile 工具
性能监控，inspect 工具
更多内置应用和组件

Contact Us

Issue: github.com/MegEngine/MegFlow/issues
Email: [email protected]
Forum: discuss.megengine.org.cn
QQ Group: 1029741705
OPENI: openi.org.cn/MegEngine

License

Apache 2.0

Acknowledgement

MegFlow 模型和推理学习了这些项目：

MegEngine
onnx
YOLOX
AlignedReID
MEMD

MegFlow Python 使用了下列项目：

OpenCV
numpy
loguru
scipy
redis

MegFlow Rust 使用了以下项目：

anyhow
async-std
clap
concurrent-queue
ctrlc
ctor
dyn-clone
event-listener
ffmpeg-next
hyper
headers
image
indexmap
lazy-static
mime
numpy
oneshot
proc-macro2
pretty-env-logger
pyo3
quote
rand
rweb
serde
serde_json
stackful
syn
toml
urlencoding
warp

detail | 详细描述

Hi there, Try to build the docker as refer to the guid, but always failed with the same messages as below, any clue to fix it? Thanks!

Step 7/7 : RUN PATH=$HOME/.cargo/bin:${PATH} && cargo build && cd flow-python && python3 setup.py install --user && cd examples && cargo run --example run_with_plugins -- -p logical_test ---> Running in 9e5d7d0b6e8c Updating crates.io index Updating git repository https://github.com/nbdd0121/stackful.git Updating git repository https://github.com/Easonzero/rust-ffmpeg Updating git repository https://github.com/Easonzero/rust-ffmpeg-sys Downloading crates ...

... ... [Omitt dozens of lines]

Downloaded clang-sys v0.29.3 Downloaded h2 v0.3.3 warning: spurious network error (2 tries remaining): [28] Timeout was reached (download of ndarray v0.15.3 failed to transfer more than 10 bytes in 30s) warning: spurious network error (2 tries remaining): [28] Timeout was reached (failed to download any data for libc v0.2.100 within 30s) error: failed to download from https://crates.io/api/v1/crates/num-integer/0.1.44/download

Caused by: [92] Stream error in the HTTP/2 framing layer (HTTP/2 stream 279 was not closed cleanly before end of the underlying stream) The command '/bin/sh -c PATH=$HOME/.cargo/bin:${PATH} && cargo build && cd flow-python && python3 setup.py install --user && cd examples && cargo run --example run_with_plugins -- -p logical_test' returned a non-zero code: 101