sillycat
- 浏览: 2564371 次
- 性别:
- 来自: 成都
-
最新评论
-
nation：
你好，在部署Mesos+Spark的运行环境时，出现一个现象， ...
Spark(4)Deal with Mesos -
sillycat：
AMAZON Relatedhttps://www.godad ...
AMAZON API Gateway(2)Client Side SSL with NGINX -
sillycat：
sudo usermod -aG docker ec2-use ...
Docker and VirtualBox(1)Set up Shared Disk for Virtual Box -
sillycat：
Every Half an Hour30 * * * * /u ...
Build Home NAS(3)Data Redundancy -
sillycat：
3 List the Cron Job I Have>c ...
Build Home NAS(3)Data Redundancy
文章列表
AWS Enlarge the EC2 Root Disk Space
Go to EC in AWS Console, select the EC2 instance we have, in the Detail Description
We can see the Root Device: /dev/sda1 if we click on that, it will open the Volume Menu
Select the Volume —> Modify Volume —> Change the number to a bigger number
Restart ...
RateLimiter in NodeJS
In the package.json, we need this package
"bottleneck": "^2.18.0"
Here is the import of the module
const Bottleneck = require('bottleneck');
Here is the rate limiter configuration
const limiter = new Bottleneck({
maxConcurrent: 1,
minTime: 20
});
...
Apache Cassandra 2019 Authentication
Before
authenticator: AllowAllAuthenticator
After
authenticator: PasswordAuthenticator
Restart the Cassandra Service
Connect to it with the default username and password
> cqlsh -u cassandra -p cassandra 127.0.0.1 9042
Change the default user and password
> ...
Apache Cassandra 2019 Version in Docker
I think the conf/cassandra.yaml should be from the sample
Important Makefile will be as follow:
IMAGE=sillycat/public
TAG=ubuntu-cassandra
NAME=ubuntu-cassandra
prepare:
wget http://apache.osuosl.org/cassandra/3.11.4/apache-cassandra-3.11.4-bin.tar.gz -P i ...
Migrate Data from MySQL to DynamoDB
Directly writes to the DynamoDB
https://github.com/audienceproject/spark-dynamodb
I was thinking this should work, but it does not working at reading
%spark.dep
z.load("mysql:mysql-connector-java:5.1.47")
z.load("com.github.traviscrawford:spark-dyna ...
Nginx Proxy and Redirect from Root Path
location = /index {
}
It means exactly match.
location = /index.html {
resolver {{resolver_server_list}};
proxy_pass https://manage.{{short_domain}};
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_f ...
Nginx Manage the Cookie in Response
My requirement is to delete the Response Cookie in my NGINX.
At first, I was trying
proxy_hide_header Set-Cookie
It can remove the response header Set-Cookie. So the HTTP response will not have this in the header.
But actually, my requirement is to delete one Co ...
TypeScript and NodeJS Package and Dependency
Recently, my project requires a base64 library. I was confused at first.
I think both base64 library works, but they are all nodeJS library. When I have it in my TypeScript project dependencies, they are saying we need something with @type there.
So we ...
Connection and Timeout in RabbitMQ NodeJS
In our simple script, we are write a sendToQueue.js in NodeJS to send out JSON file content to RabbitMQ. I think we just follow the example in RabbitMQ and do it like this
// Usage: node sendToQueue.js meeting-to-update-stage.json
{
const amqp = require('amq ...
Find Data in DynamoDB in Spark
I get a small task recently, in our DynamoDB, there is one column in one table, at first we put bad data in table saying extension as Number, later we know it should be String.
But that end up we have some Number and some String in the same column. We need to find out ...
Jenkins and ECR
First of all, create a repository in the Amazon ECR Repositories
I get a URL as follow
703986672610.dkr.ecr.us-west-2.amazonaws.com/netsuite
Find my AWS security and key, it seems I do not have permission to generate one.
[AWS Management Console] —> [My Security Credentials]
I get ...
Ad Solution SMS(1)Open Source Message Send
Clone the Project First
> git clone https://github.com/typpo/textbelt
Check my ENV
> node --version && npm --version
v8.10.0
3.5.2
Directly call their official website
> curl -X POST http://textbelt.com/text -d number=512785xxx -d message=& ...
Generate JSON with Null Columns in Spark
Install JDK8 Oracle on Ubuntu 18.04
https://www.digitalocean.com/community/tutorials/how-to-install-java-with-apt-on-ubuntu-18-04
> sudo add-apt-repository ppa:webupd8team/java
> sudo apt update
> sudo apt install oracle-java8-installer
Java Version
...
Jenkins 2019 in Docker(4)Cluster using Docker
Check the docker version on 2 machines
> docker --version
Docker version 18.09.2, build 6247962
Master and Slave, set the public key to ssh each other, major is just the Master need to SSH to Slave
Manage Jenkins —> Manage Nodes —> We can see th ...
Jfrog Artifactory 2019 using MySQL Database
Go to create the database
/opt/artifactory/misc/db/createdb
cat createdb_mysql.sql
CREATE DATABASE artdb CHARACTER SET utf8 COLLATE utf8_bin;
GRANT ALL ON artdb.* TO 'artifactory'@'localhost' IDENTIFIED BY 'password';
FLUSH PRIVILEGES;
Then Try to connec ...