Designing a lock free, scalable redo log architecture for InnoDB

演讲简介：

The WAL is at the heart of the database, all changes made to the data are written to this log. This makes the WAL a very highly contented resource. On modern HW and web scale data loads this contention becomes the bottleneck of the database and limits scalability. When it can’t keep up with the rate of incoming changes it can cause very serious degradation of the service. As we try and keep up with the demands that are put on MySQL/InnoDB it is clear that we need to move towards algorithms and designs which scale. We decided to redesign the WAL and other core sub-systems like the MVCC infrastructure using lock free data structures. This talk will take you through our journey to design a lock free, scalable redo log for InnoDB and describe the architecture and design.

Sunny Bains InnoDB

嘉宾介绍：

Currently Director of Software Development and leads the InnoDB team. Joined Oracle/InnoDB in 2006 and is the architect and author of multi-threaded purge, auto-increment scalability, multiple buffer pools, the “kernel” mutex split in v5.6, the redesign of the transaction system that makes InnoDB scale for read only loads in 5.7. Implemented the Full Text Search, transportable table-spaces, and numerous optimisations in the InnoDB design. Prior to joining Oralce/InnoDB wrote a full ACID compliant storage engine from scratch for a (proprietary) distributed database that is used in the airline industry with automatic failover etc. and has to satisfy very strict service level guarantees.

新硬件环境下日志模块的设计与演进

演讲简介：

日志管理器是DBMS的一个关键部件，一般都采用集中式的设计方式。所有的事务都在一个全局缓冲区上以追加的方式插入日志记录。系统设定一个阈值，达到该阈值以后系统将缓冲区的日志记录一并写出到磁盘。这种设计方式可以在磁盘作为持久性存储介质的情况下很好地运作。因为它可以避免由I/O带来的频繁的磁头移动。然而，在多核环境下这种集中的设计容易成为系统瓶颈，影响系统性能。围绕着多核处理器与非易失性内存，阐述日志模块的设计与演进，聚焦降低软件复杂度与高性能。大纲如下： 1. ARIES算法下日志模块的设计与不足 （阐述ARIES算法下日志模块的设计） 2. PostgreSQL与InnoDB日志模块的演进 （分析Pg与InnoDB的日志模块设计与改进） 3. 非易失性内存带来的重构机遇 （分析数据库3大学术会议中最新的研究成果与趋势） 4. 探讨OS日志模块在非易失性内存下的设计 （借鉴OS领域中非易失性内存下日志模块 的设计，带给数据库系统的借鉴） 5. 总结 （探讨未来非易失性内存下数据库系统日志模块的存在方式，可否去除恢复子系 统，如果保留，以何种方式最优地存在）

朱阅岸 YY Research LAB 数据库专家

嘉宾介绍：

中国人民大学博士，现供职于腾讯云数据库团队。研究方向主要为数据库系统理论与实现、新硬件平台下的数据库系统以及TP+AP型混合系统。目前负责腾讯CDB新硬件环境下数据库技术方向。