`
sillycat
  • 浏览: 2552937 次
  • 性别: Icon_minigender_1
  • 来自: 成都
社区版块
存档分类
最新评论

Mysql Scalability(2)Sharding - Thoughts

 
阅读更多

Mysql Scalability(2)Sharding - Thoughts

1. Amoeba
Build Codes and Installation
>svn checkout http://amoeba.googlecode.com/svn/trunk amoeba-svn

Install ant on MAC to build that.
>ant -version
Apache Ant(TM) version 1.9.4 compiled on April 29 2014

Just build it ,we will get the binary file amoeba-mysql-binary-2.2.0.tar.gz
>mkdir amoeba-mysql-binary-2.2.0
>cd amoeba-mysql-binary-2.2.0/
>tar zxvf amoeba-mysql-binary-2.2.0.tar.gz

Move to working directory
>mv amoeba-mysql-binary-2.2.0 /Users/carl/tool/amoeba-mysql-2.2.0
>sudo ln -s /Users/carl/tool/amoeba-mysql-2.2.0 /opt/amoeba-mysql-2.2.0
>sudo ln -s /opt/amoeba-mysql-2.2.0 /opt/amoeba-mysql

Add to Path /opt/amoeba-mysql

Verify the Installation is done.
>amoeba
amoeba start|stop

Configuration Basic
databases connections
conf/dbServers.xml

sharding rule
conf/rule.xml

access IP list
conf/access_list.conf

One DB node
Seems that I only can get the 2.2.0 version of the source codes, and the 2.2.0 binary is having class load problem on jdk1.6. And I do not plan to use 3.0.5 without source codes.

2. vitess
No enough document and source codes to understand that.

3. Atlas
https://github.com/Qihoo360/Atlas

Based on Mysql-Proxy, but do not support multiple DB rules, only support multiple tables.

4. Cobar
Nice code and nice document, but open source part does not support separate reads and writes.

Tips
Show the Slow Query
>sudo vi /etc/mysql/my.cnf
log_slow_queries    = /var/log/mysql/mysql-slow.log long_query_time = 5 #log-queries-not-using-indexes

But when I start this mysql server I got error as follow
>sudo mysqld --verbose
2014-07-24 15:59:25 3340 [ERROR] mysqld: unknown variable 'log_slow_queries=/var/log/mysql/mysql-slow.log' 2014-07-24 15:59:25 3340 [ERROR] Aborting

Solution:
This is the right configuration for mysql 5.6
slow-query-log-file = /var/log/mysql/mysql-slow.log long_query_time = 5 #log-queries-not-using-indexes

Change the user and group
>sudo chown mysql:mysql pathname

References:
http://sillycat.iteye.com/blog/2094908  Master-Slave

http://docs.hexnova.com/amoeba/index.html
https://code.google.com/p/amoeba/source/checkout
https://www.centos.bz/2012/05/amoeba-for-mysql/
http://www.aslibra.com/blog/post/amoeba_mysql_proxy_rw_split.php
http://www.cnblogs.com/taven/archive/2012/09/11/2680282.html
http://boke.25k5.com/kan16489.html

https://github.com/vispractice/Amoeba-Plus-For-MySQL

vitess
https://github.com/youtube/vitess
https://code.google.com/p/vitess/

show slow SQL
https://www.centos.bz/2012/01/active-mysql-slow-log-mysqldumpslow/

分享到:
评论

相关推荐

    Designing for Scalability with Erlang-OTP.pdf

    Designing for Scalability with Erlang-OTP.pdf Designing for Scalability with Erlang-OTP.pdf Designing for Scalability with Erlang-OTP.pdf

    Overview of fine granularity scalability in MPEG-4 video standard

    2. **适应性传输**:在网络视频传输中,尤其是在互联网环境中,网络带宽的变化非常大。传统的视频编码技术往往假设编码器了解传输通道的容量,并据此优化视频质量。而在基于互联网的流媒体视频传输中,由于存在视频...

    Bit-Rate-Scalability-in-Audio-Coding

    2. **分块编码**:音频信号被分割成多个块,每个块可以独立编码并分配不同的比特率。在网络状况良好时,可以选择传输更高质量的块;在网络拥堵时,优先保证低质量块的传输,确保基本的音频质量。 3. **参数编码与...

    Robustness Communication Software -- Extreme Availability, Reliability and Scalability for Carrier-Grade System

    综上所述,《Robustness Communication Software -- Extreme Availability, Reliability and Scalability for Carrier-Grade System》这本书提供了关于如何设计高性能、高可靠性、高可用性以及高伸缩性的电信级系统...

    Java Performance and Scalability(Server-Side Programming Techniques)

    学习java性能调优的好书,国外专家写的,很不错

    mysql-ref-5.6-en.pdf

    - **HA/Scalability Guide**:提供了关于如何构建高可用和可扩展MySQL架构的指南。 - **备份与恢复**:介绍了备份策略和恢复流程,确保数据的安全性和可靠性。 - **虚拟化**:讨论了MySQL在虚拟化环境中的部署和管理...

    mysql5.0参考手册-english

    根据提供的文件信息,我们可以从多个角度来探讨与MySQL 5.0相关的知识点。以下是对这些知识点的详细解析: ### MySQL 5.0 参考手册概述 #### 1. **MySQL 5.0版本覆盖范围** - **版本详情**:此手册涵盖了MySQL ...

    MySQL5.5使用手册---refman-5.5-en.pdf

    #### 2. MySQL Workbench MySQL Workbench 是一个用于管理 MySQL 服务器的强大图形化工具,它提供了数据建模、SQL 开发以及全面的管理功能。这对于开发人员和数据库管理员来说是一个非常有用的工具。 #### 3. 精确...

    mysql_refman-5.6-en.a4.pdf

    - **HA/Scalability Guide**:高可用性和可扩展性指南,讲解如何构建高可用和高性能的MySQL集群。 - **Server Administration**:服务器管理指南,涵盖服务器的安装、配置和维护等内容。 - **MySQL Yum ...

    MySQL 8 Administrator's Guide

    MySQL 8 Administrator's Guide pdf ...MySQL 8 - Scalability & High Availability MySQL 8 - Security Optimizing MySQL 8 Extending MySQL 8 MySQL 8 Best Practices & Benchmarking Troubleshooting MySQL 8

    OSG Scalability Area Tools-开源

    2. **压力测试**:模拟高并发情况,检查系统的最大处理能力,找出可能的崩溃点。 3. **资源利用率监控**:跟踪CPU、内存、网络和存储资源的使用情况,以便进行调整优化。 4. **故障检测与恢复**:检测系统故障并自动...

    designing-for-scalability-with-erlang-otp-exercises:“Designing for Scalability with ErlangOTP”书籍练习

    使用 Erlang/OTP 设计可扩展性 - 练习 在这个存储库中,我将阅读 Francesco Cesarini 和 Steve Vinoski 所著的“Designing for scaling with Erlang and Otp”一书时编写的代码组合在一起,你可以在购买这本书。...

    The Art of Scalability

    "Scalability Mastery" Scalability是指系统、软件或应用程序能够满足增长和变化的需求,而不影响其性能和可靠性。Scalability是一个非常重要的概念,在现代软件开发和 IT 行业中扮演着关键角色。下面是从《The Art...

    mysql5.6手册英文版本

    ##### 3.4 HA/Scalability Guide - **高可用性**: 包括 MySQL Thread Pool、MySQL Partitioning 等。 - **扩展性**: 如 MySQL Proxy、MySQL and Virtualization 等。 #### 四、安全与合规 ##### 4.1 Security - ...

    mysql-installer-web-community-5.7.29.0.msi + .NET Framework 4.5.2 安装包

    MySQL + .NET Framework 4.5.2 安装包 ...MySQL Cluster enables users to meet the database challenges of next generation web, cloud, and communications services with uncompromising scalability, uptime...

    Guide to Scaling Web Databases with MySQL Cluster

    Auto-sharding for write-scalability; SQL and NoSQL interfaces; Real-time responsiveness; Active / active geographic replication; Online scaling and schema upgrades; 99.999% availability. This Guide ...

    一步步搭建基于RedHat 7 Oracle 12c Sharding

    1. 线性扩展(Linear Scalability):Sharding消除了性能瓶颈,通过增加shard数量可以线性地扩展性能和容量。 2. 故障隔离(Fault Containment):Sharding基于共享nothing的硬件基础设施,消除了如共享磁盘、SAN和...

    MySQL V5.5帮助文档

    2. Installing and Upgrading MySQL 2.1. General Installation Guidance 2.1.1. Operating Systems Supported by MySQL Community Server 2.1.2. Choosing Which MySQL Distribution to Install 2.1.3. How to Get ...

    px2scalability-loader

    px2scalability-loader A loader for Install npm install px2scalability-loader webpack-config module.exports = { // ... module: { rules: [ { test: /\.(scss|sass)$/, use: ExtractTextWebpackPlugin....

Global site tag (gtag.js) - Google Analytics