Skip to content

[NEW] Split Files on Linux #1461

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 26 commits into from
Feb 2, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
e8badf2
Draft of Split guide
Jskobos Jan 29, 2018
04cf8b2
Draft complete
Jskobos Jan 30, 2018
a157bd0
Update install-alpine-linux-on-your-linode.md
cwlinode Jan 30, 2018
f9e3cb3
Update how-to-use-block-storage-with-your-linode.md
cwlinode Jan 30, 2018
ddac055
[NEW] Thingsboard Guide (#1374)
Jskobos Jan 30, 2018
f53dac5
[UPDATE] Create Physical Backups of a MySQL Database [UPDATE] Use mys…
cwlinode Jan 31, 2018
5d7239c
Fix spelling errors from Vale initial fix (#1470)
GuessWhoSamFoo Jan 31, 2018
2f0a710
Rebuild theme
cwlinode Jan 31, 2018
c86e164
Fix indentation for code blocks in sublists
Jan 31, 2018
281b247
[NEW] Elasticsearch plugins -Tylerjl (#1368)
Guaris Jan 31, 2018
ae178f7
Update index
Jskobos Jan 31, 2018
be5a67c
Clear contribute.md topics list (#1475)
Jskobos Feb 1, 2018
13cdfe6
Initial block storage fixes (#1476)
GuessWhoSamFoo Feb 1, 2018
220939a
GB -> GiB for block storage
Feb 1, 2018
9f7ec99
Add test case for file extensions (#1471)
Jskobos Feb 1, 2018
e8b8738
Remove incorrect guide
Jskobos Feb 1, 2018
34b9255
Add coreutils install for GNU split on MacOS
Feb 2, 2018
3bd90b9
Replace 'Icinga2' with 'Icinga 2' (#1481)
gunnarbeutner Feb 2, 2018
8942661
FarmOS title rename (#1480)
Guaris Feb 2, 2018
98f1ed7
Data center is two words (#1479)
GuessWhoSamFoo Feb 2, 2018
c9b2099
Add January banner images (#1485)
Jskobos Feb 2, 2018
68afdac
[UPDATE] Install Caddy on CentOS
Guaris Feb 2, 2018
a134a3b
Merge branch 'split' of https://github.com/Jskobos/docs into Jskobos-…
Feb 2, 2018
6d347ae
Copy Edit
Feb 2, 2018
fd0b61e
TRAVIS
Feb 2, 2018
bff2df1
Typo quick fix
Jskobos Feb 2, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 13 additions & 6 deletions ci/conftest.py
Original file line number Diff line number Diff line change
Expand Up @@ -21,23 +21,30 @@ def wrapper(md_filepath):
return wrapper

@pytest.fixture(scope='module', autouse=True)
def md_index(path='.', extension='*.md'):
def file_index(path='.', extension=None):
"""
Traverses root directory
"""
index = []
exclude_dir = ['node_modules', 'archetypes']
exclude_file = ['_index.md']
exclude_dir = ['node_modules', 'archetypes', '.git']
exclude_file = ['_index.md','.gitignore']
for root, dirnames, filenames in os.walk(path):
dirnames[:] = [d for d in dirnames if d not in exclude_dir]
for filename in fnmatch.filter(filenames, extension):
if extension:
filter_ext = fnmatch.filter(filenames, extension)
else:
filter_ext = filenames #Filter nothing
for filename in filter_ext:
if filename in exclude_file:
continue
index.append(os.path.join(root, filename))
return index


@pytest.fixture(params=md_index())
@pytest.fixture(params=file_index(extension='*.md'))
def md_filepath(request):
return request.param

@pytest.fixture(params=file_index(extension=None))
def all_filepaths(request):
return request.param

10 changes: 10 additions & 0 deletions ci/test_extensions.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
import pytest
import os

def test_extension(all_filepaths):
"""
Tests that all file extensions are lowercase.
Ignores files without an extension.
"""
filename, file_extension = os.path.splitext(all_filepaths)
assert file_extension == file_extension.lower(), 'File extensions must be lowercase.'
Original file line number Diff line number Diff line change
Expand Up @@ -138,9 +138,9 @@ You only need to run `source` on this file once in a single terminal session, un
{{< /note >}}

- `DATACENTER`:
This specifies the Linode datacenter where the Cluster Manager Linode is created. Set it to the ID of the datacenter that is nearest to your location, to reduce network latency. It's also recommended to create the cluster manager node in the same datacenter where the images and cluster nodes will be created, so that it can communicate with them using low latency private IP addresses and reduce data transfer usage.
This specifies the Linode data center where the Cluster Manager Linode is created. Set it to the ID of the data center that is nearest to your location, to reduce network latency. It's also recommended to create the cluster manager node in the same data center where the images and cluster nodes will be created, so that it can communicate with them using low latency private IP addresses and reduce data transfer usage.

To view the list of datacenters and their IDs:
To view the list of data centers and their IDs:

source ~/storm-linode/api_env_linode.conf
~/storm-linode/linode_api.py datacenters table
Expand Down Expand Up @@ -256,7 +256,7 @@ Creating a new Storm cluster involves four main steps, some of which are necessa

### Create a Zookeeper Image

A *Zookeeper image* is a master disk image with all necessary Zookeeper softwares and libraries installed. We'll create our using [Linode Images](/docs/platform/linode-images) The benefits of using a Zookeeper image include:
A *Zookeeper image* is a master disk image with all necessary Zookeeper software and libraries installed. We'll create our using [Linode Images](/docs/platform/linode-images) The benefits of using a Zookeeper image include:

- Quick creation of a Zookeeper cluster by simply cloning it to create as many nodes as required, each a perfect copy of the image
- Distribution packages and third party software packages are identical on all nodes, preventing version mismatch errors
Expand Down Expand Up @@ -315,9 +315,9 @@ The values represented in this guide are current as of publication, but are subj

- `DATACENTER_FOR_IMAGE`

The Linode datacenter where this image will be created. This can be any Linode datacenter, but cluster creation is faster if the image is created in the same datacenter where the cluster will be created. It's also recommended to create the image in the same datacenter as the Cluster Manager Linode. Select a datacenter that is geographically close to your premises, to reduce network latency. If left unchanged, the Linode will be created in the Newark data center.
The Linode data center where this image will be created. This can be any Linode data center, but cluster creation is faster if the image is created in the same data center where the cluster will be created. It's also recommended to create the image in the same data center as the Cluster Manager Linode. Select a data center that is geographically close to your premises, to reduce network latency. If left unchanged, the Linode will be created in the Newark data center.

This value can either be the datacenter's ID or location or abbreviation. To see a list of all datacenters:
This value can either be the data center's ID or location or abbreviation. To see a list of all data centers:

./zookeeper-cluster-linode.sh datacenters api_env_linode.conf

Expand Down Expand Up @@ -456,11 +456,11 @@ When creating a cluster, you should have `clustermgr` authorization to the Clust

- `DATACENTER_FOR_CLUSTER`

The Linode datacenter where the nodes of this cluster will be created. All nodes of a cluster have to be in the same datacenter; they cannot span multiple datacenters since they will use private network traffic to communicate.
The Linode data center where the nodes of this cluster will be created. All nodes of a cluster have to be in the same data center; they cannot span multiple data centers since they will use private network traffic to communicate.

This can be any Linode datacenter, but cluster creation may be faster if it is created in the same datacenter where the image and Cluster Manager Linode are created. It is recommended to select a datacenter that is geographically close to your premises to reduce network latency.
This can be any Linode data center, but cluster creation may be faster if it is created in the same data center where the image and Cluster Manager Linode are created. It is recommended to select a data center that is geographically close to your premises to reduce network latency.

This value can either be the datacenter's ID or location or abbreviation. To see a list of all datacenters:
This value can either be the data center's ID or location or abbreviation. To see a list of all data centers:

./zookeeper-cluster-linode.sh datacenters api_env_linode.conf

Expand Down Expand Up @@ -520,9 +520,9 @@ When creating a cluster, you should have `clustermgr` authorization to the Clust

- `PUBLIC_HOST_NAME_PREFIX`

Every Linode in the cluster has a *public IP address*, which can be reached from anywhere on the Internet, and a *private IP address*, which can be reached only from other nodes of the same user inside the same datacenter.
Every Linode in the cluster has a *public IP address*, which can be reached from anywhere on the Internet, and a *private IP address*, which can be reached only from other nodes of the same user inside the same data center.

Accordingly, every node is given a *public hostname* that resolves to its public IP address. Each node's public hostname will use this value followed by a number (for example, `public-host1`, `public-host2`, etc.) If the cluster manager node is in a different Linode datacenter from the cluster nodes, it uses the public hostnames and public IP addresses to communicate with cluster nodes.
Accordingly, every node is given a *public hostname* that resolves to its public IP address. Each node's public hostname will use this value followed by a number (for example, `public-host1`, `public-host2`, etc.) If the cluster manager node is in a different Linode data center from the cluster nodes, it uses the public hostnames and public IP addresses to communicate with cluster nodes.

<br>

Expand All @@ -534,7 +534,7 @@ When creating a cluster, you should have `clustermgr` authorization to the Clust

- `CLUSTER_MANAGER_USES_PUBLIC_IP`

Set this value to `false` if the cluster manager node is located in the *same* Linode datacenter as the cluster nodes. This is the recommended value. Change to `true` **only** if the cluster manager node is located in a *different* Linode datacenter from the cluster nodes.
Set this value to `false` if the cluster manager node is located in the *same* Linode data center as the cluster nodes. This is the recommended value. Change to `true` **only** if the cluster manager node is located in a *different* Linode data center from the cluster nodes.

{{< caution >}}
It's important to set this correctly to avoid critical cluster creation failures.
Expand Down Expand Up @@ -642,9 +642,9 @@ The values represented in this guide are current as of publication, but are subj

- `DATACENTER_FOR_IMAGE`

The Linode datacenter where this image will be created. This can be any Linode datacenter, but cluster creation is faster if the image is created in the same datacenter where the cluster will be created. It's also recommended to create the image in the same datacenter as the Cluster Manager Linode. Select a datacenter that is geographically close to you to reduce network latency.
The Linode data center where this image will be created. This can be any Linode data center, but cluster creation is faster if the image is created in the same data center where the cluster will be created. It's also recommended to create the image in the same data center as the Cluster Manager Linode. Select a data center that is geographically close to you to reduce network latency.

This value can either be the datacenter's ID or location or abbreviation. To see a list of all datacenters:
This value can either be the data center's ID or location or abbreviation. To see a list of all data centers:

./zookeeper-cluster-linode.sh datacenters api_env_linode.conf

Expand Down Expand Up @@ -772,11 +772,11 @@ When creating a cluster, you should have `clustermgr` authorization to the Clust

- `DATACENTER_FOR_CLUSTER`

The Linode datacenter where the nodes of this cluster will be created. All nodes of a cluster have to be in the same datacenter; they cannot span multiple datacenters since they will use private network traffic to communicate.
The Linode data center where the nodes of this cluster will be created. All nodes of a cluster have to be in the same data center; they cannot span multiple data centers since they will use private network traffic to communicate.

This can be any Linode datacenter, but cluster creation may be faster if it is created in the same datacenter where the image and Cluster Manager Linode are created. It is recommended to select a datacenter that is geographically close to your premises to reduce network latency.
This can be any Linode data center, but cluster creation may be faster if it is created in the same data center where the image and Cluster Manager Linode are created. It is recommended to select a data center that is geographically close to your premises to reduce network latency.

This value can either be the datacenter's ID or location or abbreviation. To see a list of all datacenters:
This value can either be the data center's ID or location or abbreviation. To see a list of all data centers:

./zookeeper-cluster-linode.sh datacenters api_env_linode.conf

Expand Down Expand Up @@ -850,9 +850,9 @@ When creating a cluster, you should have `clustermgr` authorization to the Clust

- `NIMBUS_NODE_PUBLIC_HOSTNAME`, `SUPERVISOR_NODES_PUBLIC_HOSTNAME_PREFIX` and `CLIENT_NODES_PUBLIC_HOSTNAME_PREFIX`

Every Linode in the cluster has a *public IP address*, which can be reached from anywhere on the Internet, and a *private IP address*, which can be reached only from other nodes of the same user inside the same datacenter.
Every Linode in the cluster has a *public IP address*, which can be reached from anywhere on the Internet, and a *private IP address*, which can be reached only from other nodes of the same user inside the same data center.

Accordingly, every node is given a *public hostname* that resolves to its public IP address. Each node's public hostname will use this value followed by a number (for example, `public-host1`, `public-host2`, etc.) If the cluster manager node is in a different Linode datacenter from the cluster nodes, it uses the public hostnames and public IP addresses to communicate with cluster nodes.
Accordingly, every node is given a *public hostname* that resolves to its public IP address. Each node's public hostname will use this value followed by a number (for example, `public-host1`, `public-host2`, etc.) If the cluster manager node is in a different Linode data center from the cluster nodes, it uses the public hostnames and public IP addresses to communicate with cluster nodes.

<br>

Expand All @@ -864,7 +864,7 @@ When creating a cluster, you should have `clustermgr` authorization to the Clust

- `CLUSTER_MANAGER_USES_PUBLIC_IP`

Set this value to `false` if the cluster manager node is located in the *same* Linode datacenter as the cluster nodes. This is the recommended value and is also the default. Change to `true` **only** if the cluster manager node is located in a *different* Linode datacenter from the cluster nodes.
Set this value to `false` if the cluster manager node is located in the *same* Linode data center as the cluster nodes. This is the recommended value and is also the default. Change to `true` **only** if the cluster manager node is located in a *different* Linode data center from the cluster nodes.

{{< caution >}}
It's important to set this correctly to avoid critical cluster creation failures.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -146,7 +146,7 @@ rec = {

'pid': result['data-pid']

4. Other data attributes may be nested deeper in the HTML strucure, and can be accessed using a combination of dot and array notation. For example, the date a result was posted is stored in `datetime`, which is a data attribute of the `time` element, which is a child of a `p` tag that is a child of `result`. To access this value use the following format:
4. Other data attributes may be nested deeper in the HTML structure, and can be accessed using a combination of dot and array notation. For example, the date a result was posted is stored in `datetime`, which is a data attribute of the `time` element, which is a child of a `p` tag that is a child of `result`. To access this value use the following format:

'date': result.p.time['datetime']

Expand Down
2 changes: 1 addition & 1 deletion docs/applications/cloud-storage/tahoe-lafs-on-debian-9.md
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,7 @@ Introducers have a variety of advantages and disadvantages:
* Tell the joining machines about the currently active peers to which it can connect.
* Potential for a single point of failure. But,
* Without the introducers you would have to edit a configuration file on every node, and add a new IP address every time you insert another node into the grid.
* Allow you to configure multiple introducers to make your setup more reliable in the event of crashes or other unforeseen events, ideally, in different datacenters.
* Allow you to configure multiple introducers to make your setup more reliable in the event of crashes or other unforeseen events, ideally, in different data centers.

After you get acquainted with the initial introducer setup, you can [read about additional introducers](http://tahoe-lafs.readthedocs.io/en/latest/configuration.html#additional-introducer-definitions).

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,7 @@ All configuration files store data in YAML format. Be careful with indentation -

### List Available Locations, Images and Sizes

Before creating new instances, specify instance size: amount of system memory, CPU, and storage; location: physical location of datacenter; and image: operating system.
Before creating new instances, specify instance size: amount of system memory, CPU, and storage; location: physical location of data center; and image: operating system.

You can obtain this information with the following commands:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -131,7 +131,7 @@ end

knife cookbook upload lamp-stack

5. Add the recipe to a node's run-list, replaceing `nodename` with your chosen node's name:
5. Add the recipe to a node's run-list, replacing `nodename` with your chosen node's name:

knife node run_list add nodename "recipe[lamp-stack::apache]"

Expand Down
Loading