Mysql Scalability(2)Sharding - Thoughts
1. Amoeba
Build Codes and Installation
>svn checkout http://amoeba.googlecode.com/svn/trunk amoeba-svn
Install ant on MAC to build that.
>ant -version
Apache Ant(TM) version 1.9.4 compiled on April 29 2014
Just build it ,we will get the binary file amoeba-mysql-binary-2.2.0.tar.gz
>mkdir amoeba-mysql-binary-2.2.0
>cd amoeba-mysql-binary-2.2.0/
>tar zxvf amoeba-mysql-binary-2.2.0.tar.gz
Move to working directory
>mv amoeba-mysql-binary-2.2.0 /Users/carl/tool/amoeba-mysql-2.2.0
>sudo ln -s /Users/carl/tool/amoeba-mysql-2.2.0 /opt/amoeba-mysql-2.2.0
>sudo ln -s /opt/amoeba-mysql-2.2.0 /opt/amoeba-mysql
Add to Path /opt/amoeba-mysql
Verify the Installation is done.
>amoeba
amoeba start|stop
Configuration Basic
databases connections
conf/dbServers.xml
sharding rule
conf/rule.xml
access IP list
conf/access_list.conf
One DB node
Seems that I only can get the 2.2.0 version of the source codes, and the 2.2.0 binary is having class load problem on jdk1.6. And I do not plan to use 3.0.5 without source codes.
2. vitess
No enough document and source codes to understand that.
3. Atlas
https://github.com/Qihoo360/Atlas
Based on Mysql-Proxy, but do not support multiple DB rules, only support multiple tables.
4. Cobar
Nice code and nice document, but open source part does not support separate reads and writes.
Tips
Show the Slow Query
>sudo vi /etc/mysql/my.cnf
log_slow_queries = /var/log/mysql/mysql-slow.log long_query_time = 5 #log-queries-not-using-indexes
But when I start this mysql server I got error as follow
>sudo mysqld --verbose
2014-07-24 15:59:25 3340 [ERROR] mysqld: unknown variable 'log_slow_queries=/var/log/mysql/mysql-slow.log' 2014-07-24 15:59:25 3340 [ERROR] Aborting
Solution:
This is the right configuration for mysql 5.6
slow-query-log-file = /var/log/mysql/mysql-slow.log long_query_time = 5 #log-queries-not-using-indexes
Change the user and group
>sudo chown mysql:mysql pathname
References:
http://sillycat.iteye.com/blog/2094908 Master-Slave
http://docs.hexnova.com/amoeba/index.html
https://code.google.com/p/amoeba/source/checkout
https://www.centos.bz/2012/05/amoeba-for-mysql/
http://www.aslibra.com/blog/post/amoeba_mysql_proxy_rw_split.php
http://www.cnblogs.com/taven/archive/2012/09/11/2680282.html
http://boke.25k5.com/kan16489.html
https://github.com/vispractice/Amoeba-Plus-For-MySQL
vitess
https://github.com/youtube/vitess
https://code.google.com/p/vitess/
show slow SQL
https://www.centos.bz/2012/01/active-mysql-slow-log-mysqldumpslow/
- 浏览: 2552937 次
- 性别:
- 来自: 成都
最新评论
-
nation:
你好,在部署Mesos+Spark的运行环境时,出现一个现象, ...
Spark(4)Deal with Mesos -
sillycat:
AMAZON Relatedhttps://www.godad ...
AMAZON API Gateway(2)Client Side SSL with NGINX -
sillycat:
sudo usermod -aG docker ec2-use ...
Docker and VirtualBox(1)Set up Shared Disk for Virtual Box -
sillycat:
Every Half an Hour30 * * * * /u ...
Build Home NAS(3)Data Redundancy -
sillycat:
3 List the Cron Job I Have>c ...
Build Home NAS(3)Data Redundancy
相关推荐
Designing for Scalability with Erlang-OTP.pdf Designing for Scalability with Erlang-OTP.pdf Designing for Scalability with Erlang-OTP.pdf
2. **适应性传输**:在网络视频传输中,尤其是在互联网环境中,网络带宽的变化非常大。传统的视频编码技术往往假设编码器了解传输通道的容量,并据此优化视频质量。而在基于互联网的流媒体视频传输中,由于存在视频...
2. **分块编码**:音频信号被分割成多个块,每个块可以独立编码并分配不同的比特率。在网络状况良好时,可以选择传输更高质量的块;在网络拥堵时,优先保证低质量块的传输,确保基本的音频质量。 3. **参数编码与...
综上所述,《Robustness Communication Software -- Extreme Availability, Reliability and Scalability for Carrier-Grade System》这本书提供了关于如何设计高性能、高可靠性、高可用性以及高伸缩性的电信级系统...
学习java性能调优的好书,国外专家写的,很不错
- **HA/Scalability Guide**:提供了关于如何构建高可用和可扩展MySQL架构的指南。 - **备份与恢复**:介绍了备份策略和恢复流程,确保数据的安全性和可靠性。 - **虚拟化**:讨论了MySQL在虚拟化环境中的部署和管理...
根据提供的文件信息,我们可以从多个角度来探讨与MySQL 5.0相关的知识点。以下是对这些知识点的详细解析: ### MySQL 5.0 参考手册概述 #### 1. **MySQL 5.0版本覆盖范围** - **版本详情**:此手册涵盖了MySQL ...
#### 2. MySQL Workbench MySQL Workbench 是一个用于管理 MySQL 服务器的强大图形化工具,它提供了数据建模、SQL 开发以及全面的管理功能。这对于开发人员和数据库管理员来说是一个非常有用的工具。 #### 3. 精确...
- **HA/Scalability Guide**:高可用性和可扩展性指南,讲解如何构建高可用和高性能的MySQL集群。 - **Server Administration**:服务器管理指南,涵盖服务器的安装、配置和维护等内容。 - **MySQL Yum ...
MySQL 8 Administrator's Guide pdf ...MySQL 8 - Scalability & High Availability MySQL 8 - Security Optimizing MySQL 8 Extending MySQL 8 MySQL 8 Best Practices & Benchmarking Troubleshooting MySQL 8
2. **压力测试**:模拟高并发情况,检查系统的最大处理能力,找出可能的崩溃点。 3. **资源利用率监控**:跟踪CPU、内存、网络和存储资源的使用情况,以便进行调整优化。 4. **故障检测与恢复**:检测系统故障并自动...
使用 Erlang/OTP 设计可扩展性 - 练习 在这个存储库中,我将阅读 Francesco Cesarini 和 Steve Vinoski 所著的“Designing for scaling with Erlang and Otp”一书时编写的代码组合在一起,你可以在购买这本书。...
"Scalability Mastery" Scalability是指系统、软件或应用程序能够满足增长和变化的需求,而不影响其性能和可靠性。Scalability是一个非常重要的概念,在现代软件开发和 IT 行业中扮演着关键角色。下面是从《The Art...
##### 3.4 HA/Scalability Guide - **高可用性**: 包括 MySQL Thread Pool、MySQL Partitioning 等。 - **扩展性**: 如 MySQL Proxy、MySQL and Virtualization 等。 #### 四、安全与合规 ##### 4.1 Security - ...
MySQL + .NET Framework 4.5.2 安装包 ...MySQL Cluster enables users to meet the database challenges of next generation web, cloud, and communications services with uncompromising scalability, uptime...
Auto-sharding for write-scalability; SQL and NoSQL interfaces; Real-time responsiveness; Active / active geographic replication; Online scaling and schema upgrades; 99.999% availability. This Guide ...
1. 线性扩展(Linear Scalability):Sharding消除了性能瓶颈,通过增加shard数量可以线性地扩展性能和容量。 2. 故障隔离(Fault Containment):Sharding基于共享nothing的硬件基础设施,消除了如共享磁盘、SAN和...
2. Installing and Upgrading MySQL 2.1. General Installation Guidance 2.1.1. Operating Systems Supported by MySQL Community Server 2.1.2. Choosing Which MySQL Distribution to Install 2.1.3. How to Get ...
px2scalability-loader A loader for Install npm install px2scalability-loader webpack-config module.exports = { // ... module: { rules: [ { test: /\.(scss|sass)$/, use: ExtractTextWebpackPlugin....