Publications-Theses
Article View/Open
Publication Export
-
Google ScholarTM
NCCU Library
Citation Infomation
Related Publications in TAIR
題名 基於 NOPaxos 的 Hyperledger Fabric 序列化共識與 eBPF 效能加速
NOPaxos-Based Sequencer Consensus in Hyperledger Fabric with eBPF Performance Acceleration作者 林政委
Lin, Cheng-Wei貢獻者 郭桐惟
Kuo, Tung-Wei
林政委
Lin, Cheng-Wei關鍵詞 國立政治大學
Hyperledger Fabric
eBPF
NOPaxos
NCCU
Hyperledger Fabric
eBPF
NOPaxos日期 2025 上傳時間 1-Jul-2025 15:06:29 (UTC+8) 摘要 本研究旨在提升 Hyperledger Fabric 的交易處理效能,聚焦於共識協議中的瓶頸問題。我們採用序列器式(sequencer-based)共識機制,透過集中化的交易排序大幅減少節點間通訊開銷。比較硬體與軟體兩種實作方式後,我們發現 eBPF 技術具備嵌入序列器邏輯於作業系統核心的潛力,可有效降低上下文切換與系統延遲。透過將改良版的 NOPaxos 協議整合進 Hyperledger Fabric,並以 eBPF 實現序列器,我們在實驗中達成交易吞吐量(TPS)提升 75%、延遲降低 45% 的顯著成效,優於原生 Hyperledger Fabric 系統。
This paper focuses on improving transaction processing speeds in Hyperledger Fabric by addressing bottlenecks in consensus protocols. We explore the sequencer-based consensus protocol, which reduces node communication by centralizing transaction ordering through a sequencer. Comparing hardware and software implementations, we identify the potential of eBPF technology to enhance performance by embedding sequencer logic directly in the kernel, minimizing context switches and latency. By integrating a modified NOPaxos into Hyperledger Fabric and leveraging eBPF for the sequencer, we achieved a 75% increase in TPS and an 45% reduction in latency compared to vanilla Hyperledger Fabric.參考文獻 Androulaki, E., Barger, A., Bortnikov, V., Cachin, C., Christidis, K., Caro, A. D., … Yellick, J. (2018). Hyperledger fabric: A distributed operating system for permissioned blockchains. CoRR, abs/1801.10228. Retrieved from http://arxiv.org/abs/1801.10228 Atomix. (2019). nopaxos-replica. https://github.com/atomix/nopaxos-replica?tab=readme-ov-file#readme. GitHub. Baidya, S., Chen, Y., & Levorato, M. (2018). ebpf-based content and computation-aware communication for real-time edge computing. CoRR, abs/1805.02797. Retrieved from http://arxiv.org/abs/1805.02797 Choi, I., Michael, E., Li, Y., Ports, D. R. K., & Li, J. (2023, April). Hydra: Serialization-Free network ordering for strongly consistent distributed applications. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23) (pp. 293–320). Boston, MA: USENIX Association. Retrieved from https://www.usenix.org/conference/nsdi23/presentation/choi Cilium. (n.d.). Cilium: ebpf-based networking, observability, security. https://cilium.io/. (Accessed: 2025-04-08) Ghigoff, Y., Sopena, J., Lazri, K., Blin, A., & Muller, G. (2021, April). BMC: Accelerating memcached using safe in-kernel caching and pre-stack processing. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21) (pp. 487–501). USENIX Association. Retrieved from https://www.usenix.org/conference/nsdi21/presentation/ghigoff Gorenflo, C., Lee, S., Golab, L., & Keshav, S. (2019). Fastfabric: Scaling Hyperledger Fabric to 20,000 transactions per second. In 2019 IEEE International Conference on Blockchain and Cryptocurrency (ICBC) (p. 455–463). doi: 10.1109/BLOC.2019.8751452 Javaid, H., Yang, J., Santoso, N., Upadhyay, M., Mohan, S., Hu, C., & Brebner, G. (2022, July). Blockchain Machine: A Network-Attached Hardware Accelerator for Hyperledger Fabric. In 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS) (p. 258–268). Los Alamitos, CA, USA: IEEE Computer Society. Retrieved from https://doi.ieeecomputersociety.org/10.1109/ICDCS54860.2022.00033 doi: 10.1109/ICDCS54860.2022.00033 Katran, a scalable network load balancer. (n.d.). https://github.com/facebookincubator/katran. (Accessed: 2025-04-08) Kuhring, L., Istvan, Z., Sorniotti, A., & Vukolic, M. (2021, December). StreamChain: Building a Low-Latency Permissioned Blockchain For Enterprise Use-Cases. In 2021 IEEE International Conference on Blockchain (BLOCKCHAIN) (p. 130–139). Los Alamitos, CA, USA: IEEE Computer Society. doi: 10.1109/Blockchain53845.2021.00027 Lamport, L. (1998, May). The part-time parliament. ACM Trans. Comput. Syst., 16(2), 133–169. Retrieved from https://doi.org/10.1145/279227.279229 Lamport, L. (2001). Paxos made simple. ACM SIGACT News (Distributed Computing Column) 32, 4 (Whole Number 121, December 2001), 51–58. Li, J., Michael, E., & Ports, D. R. K. (2017). Eris: Coordination-free consistent transactions using in-network concurrency control. In Proceedings of the 26th Symposium on Operating Systems Principles (p. 104–120). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3132747.3132751 Li, J., Michael, E., Sharma, N. K., Szekeres, A., & Ports, D. R. K. (2016, November). Just say NO to Paxos overhead: Replacing consensus with network ordering. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) (pp. 467–483). Savannah, GA: USENIX Association. Retrieved from https://www.usenix.org/conference/osdi16/technical-sessions/presentation/li Nakamoto, S. (2009, May). Bitcoin: A peer-to-peer electronic cash system. Retrieved from http://www.bitcoin.org/bitcoin.pdf Ongaro, D., & Ousterhout, J. (2014, June). In search of an understandable consensus algorithm. In 2014 USENIX Annual Technical Conference (USENIX ATC 14) (pp. 305–319). Philadelphia, PA: USENIX Association. Retrieved from https://www.usenix.org/conference/atc14/technical-sessions/presentation/ongaro Park, S., Zhou, D., Qian, Y., Calciu, I., Kim, T., & Kashyap, S. (2022, July). Application-Informed Kernel Synchronization Primitives. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22) (pp. 667–682). Carlsbad, CA: USENIX Association. Retrieved from https://www.usenix.org/conference/osdi22/presentation/park Qi, J., Chen, X., Jiang, Y., Jiang, J., Shen, T., Zhao, S., … Cui, H. (2021). Bidl: A high-throughput, low-latency permissioned blockchain framework for datacenter networks. In Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles (p. 18–34). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3477132.3483574 Qi, S., Monis, L., Zeng, Z., Wang, I.-C., & Ramakrishnan, K. K. (2022). Spright: Extracting the Server from Serverless Computing! High-Performance eBPF-Based Event-Driven, Shared-Memory Processing. In Proceedings of the ACM SIGCOMM 2022 Conference (p. 780–794). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3544216.3544259 Ruan, P., Loghin, D., Ta, Q., Zhang, M., Chen, G., & Ooi, B. C. (2020). A transactional perspective on execute-order-validate blockchains. CoRR, abs/2003.10064. Retrieved from https://arxiv.org/abs/2003.10064 Schuh, H. N., Liang, W., Liu, M., Nelson, J., & Krishnamurthy, A. (2021). Xenic: SmartNIC-Accelerated Distributed Transactions. In Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles (p. 740–755). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3477132.3483555 Sharma, A., Schuhknecht, F. M., Agrawal, D., & Dittrich, J. (2019). Blurring the Lines Between Blockchains and Database Systems: The Case of Hyperledger Fabric. In Proceedings of the 2019 International Conference on Management of Data (p. 105–122). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3299869.3319883 Sun, G., Jiang, M., Khooi, X. Z., Li, Y., & Li, J. (2023). NeoBFT: Accelerating Byzantine Fault Tolerance Using Authenticated In-Network Ordering. In Proceedings of the ACM SIGCOMM 2023 Conference (p. 239–254). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3603269.3604874 Zhou, Y., Wang, Z., Dharanipragada, S., & Yu, M. (2023, April). Electrode: Accelerating Distributed Protocols with eBPF. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23) (pp. 1391–1407). Boston, MA: USENIX Association. Retrieved from https://www.usenix.org/conference/nsdi23/presentation/zhou 描述 碩士
國立政治大學
資訊科學系
111753138資料來源 http://thesis.lib.nccu.edu.tw/record/#G0111753138 資料類型 thesis dc.contributor.advisor 郭桐惟 zh_TW dc.contributor.advisor Kuo, Tung-Wei en_US dc.contributor.author (Authors) 林政委 zh_TW dc.contributor.author (Authors) Lin, Cheng-Wei en_US dc.creator (作者) 林政委 zh_TW dc.creator (作者) Lin, Cheng-Wei en_US dc.date (日期) 2025 en_US dc.date.accessioned 1-Jul-2025 15:06:29 (UTC+8) - dc.date.available 1-Jul-2025 15:06:29 (UTC+8) - dc.date.issued (上傳時間) 1-Jul-2025 15:06:29 (UTC+8) - dc.identifier (Other Identifiers) G0111753138 en_US dc.identifier.uri (URI) https://nccur.lib.nccu.edu.tw/handle/140.119/157812 - dc.description (描述) 碩士 zh_TW dc.description (描述) 國立政治大學 zh_TW dc.description (描述) 資訊科學系 zh_TW dc.description (描述) 111753138 zh_TW dc.description.abstract (摘要) 本研究旨在提升 Hyperledger Fabric 的交易處理效能,聚焦於共識協議中的瓶頸問題。我們採用序列器式(sequencer-based)共識機制,透過集中化的交易排序大幅減少節點間通訊開銷。比較硬體與軟體兩種實作方式後,我們發現 eBPF 技術具備嵌入序列器邏輯於作業系統核心的潛力,可有效降低上下文切換與系統延遲。透過將改良版的 NOPaxos 協議整合進 Hyperledger Fabric,並以 eBPF 實現序列器,我們在實驗中達成交易吞吐量(TPS)提升 75%、延遲降低 45% 的顯著成效,優於原生 Hyperledger Fabric 系統。 zh_TW dc.description.abstract (摘要) This paper focuses on improving transaction processing speeds in Hyperledger Fabric by addressing bottlenecks in consensus protocols. We explore the sequencer-based consensus protocol, which reduces node communication by centralizing transaction ordering through a sequencer. Comparing hardware and software implementations, we identify the potential of eBPF technology to enhance performance by embedding sequencer logic directly in the kernel, minimizing context switches and latency. By integrating a modified NOPaxos into Hyperledger Fabric and leveraging eBPF for the sequencer, we achieved a 75% increase in TPS and an 45% reduction in latency compared to vanilla Hyperledger Fabric. en_US dc.description.tableofcontents Abstract ii Contents iii List of Figures v 1 Introduction 1 2 Background 6 2.1 Hyperledger Fabric 6 2.2 eBPF (extended Berkeley Packet Filter) 8 2.3 NOPaxos: A Sequencer-Based Consensus Protocol 10 3 Our Proposed eBPF-Based NOPaxos Architecture for Hyperledger Fabric 13 3.1 Integrating NOPaxos into the Hyperledger Fabric Transaction Pipeline 14 3.2 Sequencer Implementation in eBPF 16 3.2.1 Approach 1 – Using an Additional Mapping Table for IP Packet IDs 18 3.2.2 Approach 2 – Using the TTL Field in the IP Header 20 3.3 Fabric Modifications for NOPaxos Integration 22 3.4 End-Host Sequencer Implementation 23 3.5 Discussion 24 4 Evaluation 27 4.1 Experimental Setup 27 4.2 Performance Comparison of Raft and NOPaxos in Hyperledger Fabric 28 4.3 Raw UDP Packet Processing Performance: eBPF vs. End-Host 30 4.3.1 TPS and Latency Comparison 31 4.3.2 Time-Series Evaluation of Latency and Throughput in eBPF-Based Sequencer 33 4.3.3 Bottleneck Analysis of eBPF-Based Sequencer Packet Path 35 4.3.4 Variant UDP Packet Size 42 4.4 Summary of Key Insights 43 5 Related Work 45 5.1 Sequencer-based consensus protocol 45 5.1.1 Consensus protocol 45 5.1.2 Implementation of sequencers 46 5.2 Improvements to HLF 47 5.3 eBPF (extended Berkeley Packet Filter) 48 6 Conclusions 51 References 52 zh_TW dc.format.extent 991125 bytes - dc.format.mimetype application/pdf - dc.source.uri (資料來源) http://thesis.lib.nccu.edu.tw/record/#G0111753138 en_US dc.subject (關鍵詞) 國立政治大學 zh_TW dc.subject (關鍵詞) Hyperledger Fabric zh_TW dc.subject (關鍵詞) eBPF zh_TW dc.subject (關鍵詞) NOPaxos zh_TW dc.subject (關鍵詞) NCCU en_US dc.subject (關鍵詞) Hyperledger Fabric en_US dc.subject (關鍵詞) eBPF en_US dc.subject (關鍵詞) NOPaxos en_US dc.title (題名) 基於 NOPaxos 的 Hyperledger Fabric 序列化共識與 eBPF 效能加速 zh_TW dc.title (題名) NOPaxos-Based Sequencer Consensus in Hyperledger Fabric with eBPF Performance Acceleration en_US dc.type (資料類型) thesis en_US dc.relation.reference (參考文獻) Androulaki, E., Barger, A., Bortnikov, V., Cachin, C., Christidis, K., Caro, A. D., … Yellick, J. (2018). Hyperledger fabric: A distributed operating system for permissioned blockchains. CoRR, abs/1801.10228. Retrieved from http://arxiv.org/abs/1801.10228 Atomix. (2019). nopaxos-replica. https://github.com/atomix/nopaxos-replica?tab=readme-ov-file#readme. GitHub. Baidya, S., Chen, Y., & Levorato, M. (2018). ebpf-based content and computation-aware communication for real-time edge computing. CoRR, abs/1805.02797. Retrieved from http://arxiv.org/abs/1805.02797 Choi, I., Michael, E., Li, Y., Ports, D. R. K., & Li, J. (2023, April). Hydra: Serialization-Free network ordering for strongly consistent distributed applications. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23) (pp. 293–320). Boston, MA: USENIX Association. Retrieved from https://www.usenix.org/conference/nsdi23/presentation/choi Cilium. (n.d.). Cilium: ebpf-based networking, observability, security. https://cilium.io/. (Accessed: 2025-04-08) Ghigoff, Y., Sopena, J., Lazri, K., Blin, A., & Muller, G. (2021, April). BMC: Accelerating memcached using safe in-kernel caching and pre-stack processing. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21) (pp. 487–501). USENIX Association. Retrieved from https://www.usenix.org/conference/nsdi21/presentation/ghigoff Gorenflo, C., Lee, S., Golab, L., & Keshav, S. (2019). Fastfabric: Scaling Hyperledger Fabric to 20,000 transactions per second. In 2019 IEEE International Conference on Blockchain and Cryptocurrency (ICBC) (p. 455–463). doi: 10.1109/BLOC.2019.8751452 Javaid, H., Yang, J., Santoso, N., Upadhyay, M., Mohan, S., Hu, C., & Brebner, G. (2022, July). Blockchain Machine: A Network-Attached Hardware Accelerator for Hyperledger Fabric. In 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS) (p. 258–268). Los Alamitos, CA, USA: IEEE Computer Society. Retrieved from https://doi.ieeecomputersociety.org/10.1109/ICDCS54860.2022.00033 doi: 10.1109/ICDCS54860.2022.00033 Katran, a scalable network load balancer. (n.d.). https://github.com/facebookincubator/katran. (Accessed: 2025-04-08) Kuhring, L., Istvan, Z., Sorniotti, A., & Vukolic, M. (2021, December). StreamChain: Building a Low-Latency Permissioned Blockchain For Enterprise Use-Cases. In 2021 IEEE International Conference on Blockchain (BLOCKCHAIN) (p. 130–139). Los Alamitos, CA, USA: IEEE Computer Society. doi: 10.1109/Blockchain53845.2021.00027 Lamport, L. (1998, May). The part-time parliament. ACM Trans. Comput. Syst., 16(2), 133–169. Retrieved from https://doi.org/10.1145/279227.279229 Lamport, L. (2001). Paxos made simple. ACM SIGACT News (Distributed Computing Column) 32, 4 (Whole Number 121, December 2001), 51–58. Li, J., Michael, E., & Ports, D. R. K. (2017). Eris: Coordination-free consistent transactions using in-network concurrency control. In Proceedings of the 26th Symposium on Operating Systems Principles (p. 104–120). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3132747.3132751 Li, J., Michael, E., Sharma, N. K., Szekeres, A., & Ports, D. R. K. (2016, November). Just say NO to Paxos overhead: Replacing consensus with network ordering. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) (pp. 467–483). Savannah, GA: USENIX Association. Retrieved from https://www.usenix.org/conference/osdi16/technical-sessions/presentation/li Nakamoto, S. (2009, May). Bitcoin: A peer-to-peer electronic cash system. Retrieved from http://www.bitcoin.org/bitcoin.pdf Ongaro, D., & Ousterhout, J. (2014, June). In search of an understandable consensus algorithm. In 2014 USENIX Annual Technical Conference (USENIX ATC 14) (pp. 305–319). Philadelphia, PA: USENIX Association. Retrieved from https://www.usenix.org/conference/atc14/technical-sessions/presentation/ongaro Park, S., Zhou, D., Qian, Y., Calciu, I., Kim, T., & Kashyap, S. (2022, July). Application-Informed Kernel Synchronization Primitives. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22) (pp. 667–682). Carlsbad, CA: USENIX Association. Retrieved from https://www.usenix.org/conference/osdi22/presentation/park Qi, J., Chen, X., Jiang, Y., Jiang, J., Shen, T., Zhao, S., … Cui, H. (2021). Bidl: A high-throughput, low-latency permissioned blockchain framework for datacenter networks. In Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles (p. 18–34). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3477132.3483574 Qi, S., Monis, L., Zeng, Z., Wang, I.-C., & Ramakrishnan, K. K. (2022). Spright: Extracting the Server from Serverless Computing! High-Performance eBPF-Based Event-Driven, Shared-Memory Processing. In Proceedings of the ACM SIGCOMM 2022 Conference (p. 780–794). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3544216.3544259 Ruan, P., Loghin, D., Ta, Q., Zhang, M., Chen, G., & Ooi, B. C. (2020). A transactional perspective on execute-order-validate blockchains. CoRR, abs/2003.10064. Retrieved from https://arxiv.org/abs/2003.10064 Schuh, H. N., Liang, W., Liu, M., Nelson, J., & Krishnamurthy, A. (2021). Xenic: SmartNIC-Accelerated Distributed Transactions. In Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles (p. 740–755). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3477132.3483555 Sharma, A., Schuhknecht, F. M., Agrawal, D., & Dittrich, J. (2019). Blurring the Lines Between Blockchains and Database Systems: The Case of Hyperledger Fabric. In Proceedings of the 2019 International Conference on Management of Data (p. 105–122). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3299869.3319883 Sun, G., Jiang, M., Khooi, X. Z., Li, Y., & Li, J. (2023). NeoBFT: Accelerating Byzantine Fault Tolerance Using Authenticated In-Network Ordering. In Proceedings of the ACM SIGCOMM 2023 Conference (p. 239–254). New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3603269.3604874 Zhou, Y., Wang, Z., Dharanipragada, S., & Yu, M. (2023, April). Electrode: Accelerating Distributed Protocols with eBPF. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23) (pp. 1391–1407). Boston, MA: USENIX Association. Retrieved from https://www.usenix.org/conference/nsdi23/presentation/zhou zh_TW
