中间件

• Flag
• 搜索引擎
• 分布式追踪
• 消息队列
• RPC
• SSO
  • CAS
  • OAuth2
• 报表看板大屏

Flag

• 对象存储 https://github.com/pig-mesh/oss-spring-boot-starter (opens new window)
• 容错分布式系统 https://github.com/atomix (opens new window)
• 分布式时间同步 https://github.com/opencomputeproject/Time-Appliance-Project (opens new window)
• 自动验收测试 https://github.com/cucumber (opens new window)
• 大数据 https://github.com/apache/hadoop (opens new window)
  • Spark、Flink、Hive、MapReduce、Presto、Impala
  • https://github.com/apache/parquet-mr (opens new window)
  • https://github.com/apache/parquet-format (opens new window)
  • https://github.com/apache/orc (opens new window)
  • Parquet原理详解 (opens new window)
• https://github.com/hpcc-systems (opens new window)
• 数据处理 https://github.com/tableau (opens new window)
• https://github.com/Kanaries/Rath (opens new window)
• https://github.com/hazelcast/hazelcast (opens new window)
• https://github.com/datahub-project/datahub (opens new window)
• https://github.com/spotify/luigi (opens new window)
• 内存缓存 https://github.com/topics/memory-cache (opens new window)
• 钩子服务 https://github.com/svix/svix-webhooks (opens new window)
• 数据集成 https://github.com/orbitalapi/orbital (opens new window)
• 数据同步 https://github.com/mydataharbor/mydataharbor (opens new window)
• 大数据工具 https://github.com/dsc-spidal/twister2 (opens new window)
• 流处理引擎 https://github.com/hazelcast/hazelcast-jet (opens new window)
• 流处理运行 https://github.com/dataartisans/flink-dataflow (opens new window)
• API管理 https://github.com/gravitee-io/gravitee-api-management (opens new window)
• 大数据笔记 https://github.com/heibaiying/bigdata-notes (opens new window)
• 流媒体服务 https://github.com/zlmediakit/zlmediakit (opens new window)
• 微服务平台 https://github.com/1backend/1backend (opens new window)
• 即时通讯 https://github.com/crossoverjie/cim (opens new window)
• GraphQL引擎 https://github.com/hasura/graphql-engine (opens new window)
• DPDK网络 https://dpdk-docs.readthedocs.io/en/latest/index.html (opens new window)
• 游戏服务端 https://github.com/huangfeidian/mosaic_game (opens new window)
• 告警管理 https://github.com/prometheus/alertmanager (opens new window)
• Paxos共识 https://gitee.com/tjopenlab/phxpaxos (opens new window)
• API网关 https://github.com/kong/kong (opens new window)
• 网关文档 https://github.com/higress-group/higress-group.github.io (opens new window)
• API网关 https://github.com/wundergraph/wundergraph (opens new window)
• 数据捕获 https://github.com/debezium (opens new window)

搜索引擎

• https://github.com/topics/search (opens new window)
• https://github.com/topics/search-engine (opens new window)
• https://github.com/topics/search-algorithm (opens new window)
• https://github.com/topics/searching-algorithms (opens new window)
• https://github.com/topics/fuzzy-search (opens new window)
• https://github.com/topics/searching (opens new window)
• https://github.com/topics/search-in-text (opens new window)
• https://github.com/topics/fulltext-search (opens new window)
• https://github.com/topics/full-text-search (opens new window)
• https://github.com/topics/text-search (opens new window)
• https://github.com/benbusby/whoogle-search (opens new window)

• https://github.com/topics/elasticsearch (opens new window)
  • https://github.com/arkime/arkime (opens new window)
  • https://gitee.com/consolelog/chinese_translation_of_elasticsearchjavaapi (opens new window)
  • Web UI https://github.com/appbaseio/dejavu (opens new window)
  • https://github.com/deviantony/docker-elk (opens new window)
  • https://github.com/1340691923/ElasticView (opens new window)
• https://github.com/opensearch-project (opens new window)
  • https://github.com/dewitt/opensearch (opens new window)
  • GUI https://github.com/geek-fun/dockit (opens new window)
  • 企业搜索服务器 https://github.com/codelibs/fess (opens new window)
• https://github.com/opendistro-for-elasticsearch (opens new window)
• https://github.com/quickwit-oss/tantivy (opens new window)
• https://github.com/zinclabs/zincsearch (opens new window)
• https://github.com/manticoresoftware/manticoresearch (opens new window)
• https://github.com/gorse-io/gorse (opens new window)
• 文本索引 https://github.com/blugelabs/bluge (opens new window)
• https://github.com/trinodb (opens new window)
• https://github.com/sea-team/gofound (opens new window)
• https://github.com/apache/lucene-solr (opens new window)
• https://gitee.com/jd-platform-opensource/hotkey (opens new window)
• https://github.com/apache/zookeeper (opens new window)
• https://github.com/datastax (opens new window)
• https://github.com/openlink/virtuoso-opensource (opens new window)
• 搜索引擎 https://github.com/lnx-search/lnx (opens new window)
• 企业搜索 https://github.com/gerevai/gerev (opens new window)
• ES告警 https://github.com/yelp/elastalert (opens new window)
• 搜索引擎 https://github.com/nearform/lyra (opens new window)
• 区块链搜索 https://github.com/outcaste-io/outserv (opens new window)
• 搜索绑定 https://github.com/alexaltea/milli-py (opens new window)
• 搜索工具 https://github.com/a5huynh/spyglass (opens new window)
• 搜索引擎 https://manticoresearch.com/blog/manticore-alternative-to-elasticsearch (opens new window)
• ES写入 https://developer.aliyun.com/article/707156?source=5176.11533457&userCode=e4nptrfl (opens new window)
• 搜索API https://github.com/algolia (opens new window)

分布式追踪

• 服务网格 https://github.com/servicemesher (opens new window)
• 分布式追踪 https://github.com/open-telemetry (opens new window)
  • https://github.com/opentracing (opens new window)
  • https://github.com/census-instrumentation (opens new window)
  • Opentracing规范介绍 (opens new window)
  • OpenTracing概述 (opens new window)
• https://github.com/hypertrace/hypertrace (opens new window)
• https://github.com/Tencent/bk-cmdb (opens new window)
• https://github.com/openzipkin/zipkin (opens new window)
• https://github.com/dianping/cat (opens new window)
• https://github.com/librato (opens new window)
• https://github.com/DataDog (opens new window)
• https://github.com/openobserve (opens new window)
• https://github.com/sensu/sensu-go (opens new window)
• https://github.com/graphite-project (opens new window)
• https://github.com/jaegertracing (opens new window)
• 监控度量 https://github.com/micrometer-metrics (opens new window)
• 指标采集 https://github.com/telegraf (opens new window)
• https://github.com/logtail (opens new window)
• https://github.com/elastic/logstash (opens new window)
• https://github.com/fluent/fluentd (opens new window)
• https://github.com/wolfpld/tracy (opens new window)
• https://github.com/geerlingguy/internet-pi (opens new window)
• https://github.com/SigNoz/signoz (opens new window)
• https://github.com/Lakr233/Rayon (opens new window)
• https://github.com/influxdata/telegraf (opens new window)
• 集群监控 https://github.com/ganglia (opens new window)
• 应用监控 https://github.com/codecentric/spring-boot-admin (opens new window)
• https://github.com/Nepxion (opens new window)
• https://github.com/sohutv/mqcloud (opens new window)
• 日志集中管理 https://github.com/logdna (opens new window)
• https://github.com/allinurl/goaccess (opens new window)
• https://github.com/pinterest/singer (opens new window)
• https://github.com/hyperdxio/hyperdx (opens new window)
• 日志基准 https://github.com/signoz/logs-benchmark (opens new window)
• 分布式追踪 https://github.co/hypertrace (opens new window)

其他应用监控

• https://github.com/elastic/kibana (opens new window)
• https://github.com/getredash/redash (opens new window)
• https://github.com/apache/superset (opens new window)
• https://makepath.com/opensource (opens new window)
  • https://github.com/bokeh/bokeh (opens new window)
• https://github.com/cube-js/cube.js (opens new window)
• https://github.com/Freeboard/freeboard (opens new window)
• https://github.com/streamlit/streamlit (opens new window)
• https://github.com/altair-viz/altair (opens new window)
• https://github.com/treasure-data/digdag (opens new window)

• 日志服务>基本概念>术语表 (opens new window)
• SLS时序监控实战: Spring Boot应用监控最佳实践 (opens new window)

消息队列

• 协议 https://www.amqp.org (opens new window)

• AMQP的全称为：Advanced Message Queuing Protocol（高级消息队列协议）
• STOMP是简单（或流式）文本定向消息传递协议
• AMQP协议学习 (opens new window)
• AMQP基本概念 (opens new window)
• 史上最强消息队列MQ万字图文总结！ (opens new window)
• 业务消息传递(AKA Enterprise Messaging) 和 事件流（AKA Event Streaming）的区别 (opens new window)

• https://github.com/apache/rocketmq (opens new window)
• https://github.com/apache/activemq (opens new window)
• https://github.com/rabbitmq (opens new window)
  • https://github.com/mr-ping/RabbitMQ_into_Chinese (opens new window)
  • https://github.com/alanxz/rabbitmq-c (opens new window)
• https://github.com/zeromq (opens new window)
  • https://github.com/booksbyus/zguide (opens new window)
  • https://github.com/erickt/rust-zmq (opens new window)
• https://github.com/nanomsg/nng (opens new window)
• 消息数据传递 https://github.com/apache/camel (opens new window)
• https://github.com/solacedev (opens new window)
  • Kafka安装及入门 (opens new window)
  • https://github.com/confluentinc (opens new window)
  • https://github.com/smartloli/EFAK (opens new window)
  • https://github.com/aiven (opens new window)
  • https://github.com/xxd763795151/kafka-console-ui (opens new window)
  • https://github.com/kroxylicious/kroxylicious (opens new window)
• https://github.com/vectorizedio/redpanda (opens new window)
• https://github.com/apache/pulsar (opens new window)
  • Pulsar消息发送、消费架构概述 (opens new window)
• https://github.com/pravega/pravega (opens new window)
• https://github.com/nats-io (opens new window)
• https://github.com/hatchet-dev/hatchet (opens new window)
• 消息队列 https://github.com/linkall-labs/vanus (opens new window)
• 队列管理 https://github.com/provectus/kafka-ui (opens new window)
• 任务队列 https://github.com/rq/rq (opens new window)
• MQTT代理 https://github.com/baidu/bifromq (opens new window)
• Kafka管理UI https://github.com/redpanda-data/console (opens new window)
• 消息队列 https://github.com/nsqio/nsq (opens new window)
• 消息代理 https://github.com/maxwellpeterson/kafka-worker (opens new window)
• 消息队列 https://github.com/zeromq/libzmq (opens new window)
• 流处理平台 https://github.com/singularity-data/risingwave (opens new window)
• 消息队列 https://github.com/pika/pika (opens new window)
• 消息框架 https://github.com/centiservice/mats3 (opens new window)
• Kafka平台 https://github.com/didi/knowstreaming (opens new window)
• 即时通讯 https://github.com/2881099/freeim (opens new window)
• MQTT安全 https://github.com/ekoby/mqziti (opens new window)
• Kafka工具 https://github.com/kcctl/kcctl (opens new window)
• Kafka代理 https://github.com/kroxylicious/kproxy (opens new window)
• 消息队列 https://mp.weixin.qq.com/s/eitRBEhuunhS0bSl7JDksA (opens new window)
• 消息队列 https://cnblogs.com/pyedu/p/11866829.html (opens new window)
• 任务队列 https://github.com/jafarlihi/cppq (opens new window)
• 消息队列 https://github.com/memphisdev/memphis-broker (opens new window)
• RabbitMQ https://segmentfault.com/a/1190000043077665 (opens new window)
• Kafka https://mp.weixin.qq.com/s/2PEYaSiKzNfB_Ijq69UOJQ (opens new window)
• 消息幂等 https://jaskey.github.io/blog/2020/06/08/rocketmq-message-dedup (opens new window)
• RocketMQ存储 https://segmentfault.com/a/1190000042216004 (opens new window)
• Kafka原理 https://www.confluent.io/blog/preparing-the-consumer-fetch-kafka-producer-and-consumer-internals-part-3 (opens new window)
• 消息推送 https://mp.weixin.qq.com/s/xQV81HiD8hkzx2wMc3ZT7A (opens new window)
• 消息队列 https://github.com/redpanda-data/redpanda (opens new window)
• 消息队列 https://bloomberg.github.io/blazingmq (opens new window)
• 后台任务 https://github.com/resque (opens new window)
• 后台任务 https://github.com/hangfireio (opens new window)
• 消息队列选型 https://weibo.com/ttarticle/x/m/show/id/2309404803004246393088 (opens new window)

RPC

• https://github.com/topics/rpc (opens new window)
• https://github.com/topics/rpc-client (opens new window)
• https://github.com/topics/rpc-framework (opens new window)
• https://github.com/topics/oncrpc (opens new window)

• https://github.com/apache/thrift (opens new window)
• https://github.com/grpc (opens new window)
  • gRPC 官方文档中文版 (opens new window)
  • https://github.com/hashicorp/go-plugin (opens new window)
  • https://github.com/grpc-ecosystem/grpc-gateway (opens new window)
  • https://github.com/trpc-group/trpc-go (opens new window)
  • https://github.com/weibocom/motan-go (opens new window)
• https://github.com/rpcxio (opens new window)
  • https://cn.doc.rpcx.io (opens new window)
• https://github.com/twitchtv/twirp (opens new window)
• https://github.com/luxiaoxun/NettyRpc (opens new window)
• https://github.com/hprose (opens new window)
• https://sourceforge.net/projects/remotetea (opens new window)
• https://github.com/dCache/oncrpc4j (opens new window)
• https://github.com/sofastack/sofa-rpc (opens new window)
• https://github.com/apache/incubator-brpc (opens new window)
• https://github.com/bufbuild (opens new window)
• RPC框架 https://github.com/bufbuild/connect-web (opens new window)
• RPC框架 https://github.com/veal98/rpc-fromscratch (opens new window)
• RPC框架 https://github.com/he2121/myrpcfromzero (opens new window)
• RPC框架 https://github.com/unum-cloud/ujrpc (opens new window)
• RPC框架 https://github.com/k8w/tsrpc (opens new window)
• RPC规范 https://github.com/pananton/busrpc-spec (opens new window)
• gRPC框架 https://github.com/grpc/grpc (opens new window)
• gRPC框架 https://github.com/grpc/grpc-java (opens new window)
• gRPC客户端 https://github.com/getezy/ezy (opens new window)
• gRPC框架 https://github.com/hyperium/tonic (opens new window)
• gRPC C# https://grpc.io/docs/quickstart/csharp (opens new window)
• RPC框架 https://github.com/ananto30/zero (opens new window)
• gRPC开发 https://segmentfault.com/a/1190000042835130 (opens new window)
• RPC https://en.m.wikipedia.org/wiki/Remote_procedure_call (opens new window)
• JSON-RPC https://www.jsonrpc.org/specification (opens new window)
• RPC框架 https://github.com/yarpc/yarpc-go (opens new window)

SSO

单点登录（Single sign-on）是在多个应用系统中，用户只需要登录一次就可以访问所有相互信任的应用系统。 身份访问管理 (IAM)

• https://github.com/openid (opens new window)
  • https://openid.net/connect (opens new window)
  • OpenID Connect简介 (opens new window)
• https://github.com/topics/openid (opens new window)
• https://github.com/topics/openid-connect (opens new window)
• https://github.com/topics/sso (opens new window)
• https://github.com/pac4j (opens new window)
• https://github.com/casbin (opens new window)
• https://github.com/casdoor (opens new window)
• https://github.com/okta (opens new window)
• SAML https://github.com/topics/saml (opens new window)
  • https://github.com/topics/saml2 (opens new window)
• https://github.com/onelogin (opens new window)
  • https://github.com/SAML-Toolkits (opens new window)
    • https://www.samltool.com/online_tools.php (opens new window)
• https://github.com/ssoready/ssoready (opens new window)
• OpenSAML https://github.com/OpenConext/Mujina (opens new window)
• https://www.shibboleth.net/products (opens new window)
• https://www.incommon.org/software/shibboleth (opens new window)
• https://shibboleth.atlassian.net/wiki/spaces/DEV (opens new window)
• https://github.com/authelia (opens new window)
• https://github.com/goauthentik/authentik (opens new window)

LDAP

LDAP 是 Lightweight Directory Access Protocol 的缩写，即 轻量目录访问协议。 它基于 X.500 标准下更简单的子集标准开发，因此有时 LDAP 也被称之为 X.500-lite，即轻量级 x.500

• https://github.com/search?q=Ldap (opens new window)
• https://www.rfc-editor.org/rfc/rfc4510 (opens new window)
• http://www.faqs.org/rfcs/rfc2251.html (opens new window)
• https://wiki.mozilla.org/Mozilla_LDAP_SDK_Programmer%27s_Guide/Understanding_LDAP (opens new window)
• https://zh.wikipedia.org/wiki/轻型目录访问协议 (opens new window)
• https://zh.wikipedia.org/wiki/Active_Directory (opens new window)
• http://www.kingsmountain.com/ldapRoadmap.shtml (opens new window)
• http://www.jxplorer.org/links_ldap.html (opens new window)
• https://www.zytrax.com/books/ldap (opens new window)

• https://ldap.com (opens new window)
  • https://github.com/pingidentity/ldapsdk (opens new window)
  • https://sourceforge.net/projects/ldap-sdk (opens new window)
• https://www.openldap.org (opens new window)
  • https://github.com/LMDB/lmdb (opens new window)
  • https://git.openldap.org/openldap/openldap (opens new window)
• https://github.com/dsbenghe/Novell.Directory.Ldap.NETStandard (opens new window)
  • https://github.com/yuessir/Nop.Plugin.ExternalAuth.NovellActiveDirectory (opens new window)
• https://github.com/Nordes/IdentityServer4.LdapExtension (opens new window)
• ApacheDS https://github.com/apache/directory-server (opens new window)
  • https://directory.apache.org/sources.html (opens new window)
  • https://github.com/wso2/product-is (opens new window)
• 389 https://directory.fedoraproject.org (opens new window)
• OpenDJ https://github.com/OpenIdentityPlatform (opens new window)
  • https://github.com/OpenRock/OpenDJ (opens new window)
• https://github.com/longguikeji (opens new window)
• https://github.com/FreeRADIUS (opens new window)
  • https://github.com/lirantal/daloradius (opens new window)
  • https://github.com/pyradius/pyrad (opens new window)
• JOSSO https://github.com/atricore (opens new window)
• Windows https://github.com/Waffle/waffle (opens new window)
• https://sourceforge.net/projects/spnego (opens new window)
• python https://github.com/cannatag/ldap3 (opens new window)
  • https://github.com/dirkjanm/ldapdomaindump (opens new window)
• go https://github.com/go-ldap (opens new window)
• TS https://github.com/ldapts/ldapts (opens new window)

CAS

中央认证服务（Central Authentication Service），一个基于Kerberos票据方式实现SSO单点登录的集中认证服务协议

三个角色：用户/客户端（Browser），应用服务（CAS Client），单点登录服务器（CAS Server）

• 由浅入深理解Kerberos协议 (opens new window)
• 一文搞懂Kerberos (opens new window)

• https://github.com/mongodb-js/kerberos (opens new window)
• https://github.com/apereo/cas (opens new window)
  • https://github.com/jasig (opens new window)
  • https://github.com/bedework (opens new window)
  • CAS和Shiro内外网双IP动态访问 (opens new window)
  • Apereo CAS增加登录方式 (opens new window)
• https://github.com/xuxueli/xxl-sso (opens new window)

OAuth2

• https://github.com/topics/oauth2 (opens new window)

• https://github.com/aaronpk/oauth.net (opens new window)
  • https://github.com/vouch/vouch-proxy (opens new window)
  • https://github.com/enterprise-oss/osso (opens new window)
  • https://github.com/curveball/a12n-server (opens new window)
  • https://github.com/babelouest/glewlwyd (opens new window)
  • https://github.com/keycloak/keycloak (opens new window)
  • https://github.com/oauth-io (opens new window)
  • https://github.com/ory (opens new window)
  • https://github.com/simple-login/app (opens new window)
  • https://github.com/ssqsignon (opens new window)
  • https://github.com/caos/zitadel (opens new window)
  • https://github.com/curityio (opens new window)
  • https://github.com/wildfly-security/wildfly-elytron (opens new window)
• https://tools.ietf.org/html/rfc6749 (opens new window)
• 阮一峰 – 理解 OAuth 2.0 (opens new window)
• OAuth2 CSRF攻击

OAuth2是一种授权框架，提供了一套详细的授权机制（指导）。用户或应用可以通过公开的或私有的设置，授权第三方应用访问特定资源。

应用场景：OAuth2用在使用第三方账号登录的情况(比如使用weibo, qq, github登录某个app)

• OAuth2是一个相对复杂的协议, 有4种授权模式：

1. 授权码模式（authorization code）
2. 密码模式（resource owner password credentials）
3. 客户端模式（client credentials）
4. 简化模式（implicit）

• LDAP认证 https://github.com/nitnelave/lldap (opens new window)
• LDAP部署 https://segmentfault.com/a/1190000043301482 (opens new window)

报表看板大屏

• https://github.com/topics/report (opens new window)
• https://github.com/topics/bi (opens new window)
• https://github.com/topics/superset (opens new window)
• https://github.com/topics/data-visualization (opens new window)
• https://github.com/topics/business-intelligence (opens new window)
• https://gitee.com/gcpaas (opens new window)

• 开发中流行的报表工具 (opens new window)

• Java https://github.com/jeecgboot (opens new window)
• https://github.com/pentaho/pentaho-reporting (opens new window)
• https://github.com/eclipse-birt/birt (opens new window)
• https://github.com/TIBCOSoftware (opens new window)
  • https://community.jaspersoft.com (opens new window)
  • https://sourceforge.net/projects/jaspersoft (opens new window)
  • https://sourceforge.net/projects/jasperreports (opens new window)
    • https://github.com/Jaspersoft/jasperreports (opens new window)
  • https://sourceforge.net/projects/jasperstarter (opens new window)
  • JasperReport实战总结 (opens new window)
• https://github.com/zhangdaiscott/JimuReport (opens new window)
• https://gitee.com/summer-T/ureport-keep (opens new window)
  • https://www.w3cschool.cn/ureport (opens new window)
  • ureport2报表详细使用 (opens new window)
  • SpringBoot整合Ureport2 报表 及常见使用方法 (opens new window)
• https://sourceforge.net/projects/dynamicreports (opens new window)
• https://gitee.com/sulinxiubao/skp-report (opens new window)
• https://github.com/TuiQiao/CBoard (opens new window)
• https://sourceforge.net/projects/jfreereport (opens new window)
• https://github.com/tencentmusic/supersonic (opens new window)
• 数据可视化 https://github.com/dataease (opens new window)
• https://github.com/metabase/metabase (opens new window)
• https://github.com/jtablesaw/tablesaw (opens new window)
• https://github.com/datageartech/datagear (opens new window)
• https://github.com/anji-plus/report (opens new window)
  • https://gitee.com/anji-plus/report (opens new window)
• https://github.com/SHINING-TECH/EasyDisplayClient (opens new window)
• 实时风控引擎 https://github.com/wfh45678/radar (opens new window)
• C# https://github.com/FastReports/FastReport (opens new window)
• https://github.com/noneday/CellReport (opens new window)
• https://github.com/ariacom/Seal-Report (opens new window)
• 数据可视化 https://github.com/sunface/datav (opens new window)
• 数据可视化 https://github.com/xiaopujun/light-chaser (opens new window)
• 大屏设计器 https://github.com/colaiven/cola-designer (opens new window)
• 数据可视化 https://github.com/johnyan2017/smartcharts (opens new window)
• 报表工具 https://github.com/noneday/cellreport (opens new window)
• 数据可视化 https://github.com/kanaries/rath (opens new window)
• 报表工具 https://github.com/zhangdaiscott/jimureport (opens new window)
• BI报表 https://github.com/dataease/dataease (opens new window)
• 报表工具 https://github.com/xianrendzw/easyreport (opens new window)
• 报表工具 https://gitee.com/jeecg/JimuReport (opens new window)
• 数据分析 https://github.com/pingcap/ossinsight (opens new window)