Have you ever had to experiment with code or system utilities on Linux in such a way that you don’t shake the base system and take it all off in the event of a code error that should run with root privileges?

But what about the fact that, for example, it is necessary to test or run a whole cluster of various microservices on one machine? A hundred or even a thousand?

With virtual machines managed by a hypervisor, such tasks can and will succeed, but at what cost? For example, a container in LXD based on the Alpine Linux distribution minimally consumes all 7.60MBRAM, and where it takes up the root partition after startup 9.5MB!~~How do you like that, Elon Musk?~~I recommend to get acquainted with the basic capabilities of LXD - container systems in Linux

After it has generally become clear what LXD containers are, let's go ahead and think about what if there was such a platform-processor where it would be safe to run code for the host, generate graphics, dynamically (interactively) bind UI- widgets with your code, add code with text with ~~blackjack ...~~formatting? Something like an interactive blog?~~Wow ... I want it! Want!~~ :)

Look at the cat where we will launch the JupyterLab in the container - the next generation of the user interface instead of the obsolete Jupyter Notebook, and also install Python modules such as NumPy , Pandas , Matplotlib , IPyWidgets that will allow you to do all of the above and save it all in a special file - IPython-laptop .

Navigation

Plan to take off into orbit ^

We will outline a short action plan so that it is easier for us to implement the scheme above:

Alpine Linux. , .
— hostfs . . . , . , .
Bash, sudo, ,
Python,
JupyterLab, , .

, LXD, — LXD — Linux.

^

— alpine3, — jupyterlab :

lxc init alpine3 jupyterlab --profile=default --profile=hddroot

hddroot root- Storage Pool HDD :

lxc profile show hddroot

config: {}
description: ""
devices:
  root:
    path: /
    pool: hddpool
    type: disk
name: hddroot
used_by: []

lxc storage show hddpool

config:
  size: 10GB
  source: /dev/loop1
  volatile.initial_source: /dev/loop1
description: ""
name: hddpool
driver: btrfs
used_by:
- /1.0/images/ebd565585223487526ddb3607f5156e875c15a89e21b61ef004132196da6a0a3
- /1.0/profiles/hddroot
status: Created
locations:
- none

HDD SSD :) ssdroot.

STOPPED, init-:

lxc start jupyterlab

LXD -c columns :

lxc list -c ns4b
+------------+---------+-------------------+--------------+
|    NAME    |  STATE  |       IPV4        | STORAGE POOL |
+------------+---------+-------------------+--------------+
| jupyterlab | RUNNING | 10.0.5.198 (eth0) | hddpool      |
+------------+---------+-------------------+--------------+

IP , default LXD — Linux.

IP , , . , .

eth0 ( ) lxdbr0 NAT , IP — 10.0.5.5:

lxc config device add jupyterlab eth0 nic name=eth0 nictype=bridged parent=lxdbr0 ipv4.address=10.0.5.5

, :

lxc restart jupyterlab

lxc list -c ns4b
+------------+---------+------------------+--------------+
|    NAME    |  STATE  |       IPV4       | STORAGE POOL |
+------------+---------+------------------+--------------+
| jupyterlab | RUNNING | 10.0.5.5 (eth0)  | hddpool      |
+------------+---------+------------------+--------------+

^

Package	Description
bash	The GNU Bourne Again shell
bash-completion	Programmable completion for the bash shell
sudo	Give certain users the ability to run some commands as root
shadow	Password and account management tool suite with support for shadow files and PAM
tzdata	Sources for time zone and daylight saving time data
nano	Pico editor clone with enhancements

, man-pages — man man-pages mdocml-apropos less

lxc exec jupyterlab -- apk add bash bash-completion sudo shadow tzdata nano

lxc — LXD
exec — LXD,
jupyterlab —
-- — , lxc
apk — Alpine Linux
add —

, - Europe/Moscow:

lxc exec jupyterlab -- cp /usr/share/zoneinfo/Europe/Moscow /etc/localtime

-, tzdata , , , :

lxc exec jupyterlab -- apk del tzdata

lxc exec jupyterlab -- date

Wed Apr 15 10:49:56 MSK 2020

Bash , .bash_profile, .bashrc, .dir_colors /etc/skel , Bash , . , Manjaro Linux , , .

skel- . --create-dirs , :

lxc file push /etc/skel/.bash_profile jupyterlab/etc/skel/.bash_profile --create-dirs
lxc file push /etc/skel/.bashrc jupyterlab/etc/skel/.bashrc
lxc file push /etc/skel/.dir_colors jupyterlab/etc/skel/.dir_colors

root skel-:

lxc exec jupyterlab -- cp /etc/skel/.bash_profile /root/.bash_profile
lxc exec jupyterlab -- cp /etc/skel/.bashrc /root/.bashrc
lxc exec jupyterlab -- cp /etc/skel/.dir_colors /root/.dir_colors

Alpine Linux /bin/sh, root Bash:

lxc exec jupyterlab -- usermod --shell=/bin/bash root

root . - , :)

lxc exec jupyterlab -- /bin/bash -c "PASSWD=\$(head /dev/urandom | tr -dc A-Za-z0-9 | head -c 12); echo \"root:\$PASSWD\" | chpasswd && echo \"New Password: \$PASSWD\""

New Password: sFiXEvBswuWA

— jupyter JupyterLab

lxc exec jupyterlab -- useradd --create-home --shell=/bin/bash jupyter

lxc exec jupyterlab -- /bin/bash -c "PASSWD=\$(head /dev/urandom | tr -dc A-Za-z0-9 | head -c 12); echo \"jupyter:\$PASSWD\" | chpasswd && echo \"New Password: \$PASSWD\""

New Password: ZIcbzWrF8tki

, sudo, jupyter:

lxc exec jupyterlab -- groupadd --system sudo
lxc exec jupyterlab -- groupmems --group sudo --add jupyter

, jupyter:

lxc exec jupyterlab -- id -Gn jupyter

jupyter sudo

— , .

sudo sudo. , sed /etc/sudoers:

lxc exec jupyterlab -- /bin/bash -c "sed --in-place -e '/^#[ \t]*%sudo[ \t]*ALL=(ALL)[ \t]*ALL$/ s/^[# ]*//' /etc/sudoers"

JupyterLab ^

JupyterLab — Python , . , JupyterLab pip, , , , — python3 python3-dev gcc libc-dev zeromq-dev:

lxc exec jupyterlab -- apk add python3 python3-dev gcc libc-dev zeromq-dev

python- pip :

lxc exec jupyterlab -- python3 -m pip install --upgrade pip setuptools wheel

JupyterLab pip:

lxc exec jupyterlab -- python3 -m pip install jupyterlab

JupyterLab jupyterlab, , .

NodeJS — NPM, JupyterLab :

lxc exec jupyterlab -- apk add nodejs npm

JupyterLab , jupyter. , , . , JUPYTERLAB_DIR jupyter, .bashrc, :

lxc exec jupyterlab -- su -l jupyter -c "echo -e \"\nexport JUPYTERLAB_DIR=\$HOME/.local/share/jupyter/lab\" >> .bashrc"

— JupyterLab:

lxc exec jupyterlab -- su -l jupyter -c "export JUPYTERLAB_DIR=\$HOME/.local/share/jupyter/lab; jupyter labextension install --no-build @jupyter-widgets/jupyterlab-manager"

JupyterLab, :

toc — Table of Contents, /
jupyterlab-horizon-theme — UI
jupyterlab_neon_theme — UI
jupyterlab-ubu-theme — :) , GitHub

, , :

lxc exec jupyterlab -- su -l jupyter -c "export JUPYTERLAB_DIR=\$HOME/.local/share/jupyter/lab; jupyter labextension install --no-build @jupyterlab/toc @mohirio/jupyterlab-horizon-theme @yeebc/jupyterlab_neon_theme"

lxc exec jupyterlab -- su -l jupyter -c "wget -c https://github.com/microcoder/jupyterlab-ubu-theme/archive/master.zip"

lxc exec jupyterlab -- su -l jupyter -c "unzip -q master.zip && rm master.zip"

lxc exec jupyterlab -- su -l jupyter -c "export JUPYTERLAB_DIR=\$HOME/.local/share/jupyter/lab; jupyter labextension install --no-build jupyterlab-ubu-theme-master"

lxc exec jupyterlab -- su -l jupyter -c "rm -r jupyterlab-ubu-theme-master"

, , --no-build . :

lxc exec jupyterlab -- su -l jupyter -c "export JUPYTERLAB_DIR=\$HOME/.local/share/jupyter/lab; jupyter lab build"

lxc exec jupyterlab -- su -l jupyter -c "jupyter lab clean && jlpm cache clean && npm cache clean --force"

JupyterLab. , , JupyterLab bash' , , :)

jupyter:

lxc exec jupyterlab -- su -l jupyter

JupyterLab :

[jupyter@jupyterlab ~]$ jupyter lab --ip=0.0.0.0 --no-browser

web- http://10.0.5.5:8888 token . , Login. , , , JupyterLab development :

, JupyterLab , NodeJS , . /home , , , . JupyterLab.

IPython- ( JupyterLab) — /home/jupyter, () , , JupyterLab hotkey — CTRL+C y . jupyter CTRL+D.

^

, , :

lxc config device add —
jupyter —
hostfs — . .
disk —
path — LXD
source — , .

lxc config device add jupyterlab hostfs disk path=/mnt/hostfs source=/home/dv/projects/ipython-notebooks

/home/dv/projects/ipython-notebooks UID SubUID + UID, . LXD — Linux.

, jupyter, $USER :

sudo chown 1001000:$USER /home/dv/projects/ipython-notebooks

Hello, World! ^

JupyterLab, --notebook-dir /mnt/hostfs :

jupyter lab --ip=0.0.0.0 --no-browser --notebook-dir=/mnt/hostfs

http://10.0.5.5:8888 :

Python Hello World!. CTRL+ENTER "play" JupyterLab :

, , Python- ( ) Python JupyterLab, , :)

P.S. , Jupyter Jupyter Notebook JupyterLab. /tree, /lab, :

Jupyter Notebook — http://10.0.5.5:8888/tree
Jupyter Lab — http://10.0.5.5:8888/lab

Python ^

Python NumPy, Pandas, Matplotlib, IPyWidgets JupyterLab.

Python pip Alpine Linux:

g++ — , C++ Python
freetype-dev — Python Matplotlib

lxc exec jupyterlab -- apk add g++ freetype-dev

, Alpine Linux NumPy , :

ERROR: Could not build wheels for numpy which use PEP 517 and cannot be installed directly

, , , :

lxc exec jupyterlab -- apk add py3-numpy py3-numpy-dev

Python- pip. , . ~15 :

lxc exec jupyterlab -- python3 -m pip install pandas matplotlib ipywidgets

lxc exec jupyterlab -- rm -rf /home/*/.cache/pip/*
lxc exec jupyterlab -- rm -rf /root/.cache/pip/*

JupyterLab ^

JupyterLab, , . CTRL+C y , JupyterLab "", Enter :

jupyter lab --ip=0.0.0.0 --no-browser --notebook-dir=/mnt/hostfs

http://10.0.5.5:8888/lab , :

%matplotlib inline

from ipywidgets import interactive
import matplotlib.pyplot as plt
import numpy as np

def f(m, b):
    plt.figure(2)
    x = np.linspace(-10, 10, num=1000)
    plt.plot(x, m * x + b)
    plt.ylim(-5, 5)
    plt.show()

interactive_plot = interactive(f, m=(-2.0, 2.0), b=(-3, 3, 0.5))
output = interactive_plot.children[-1]
output.layout.height = '350px'
interactive_plot

, IPyWidgets UI- , Matplotlib :

IPyWidgets

? ^

, . JupyterLab " ", :) , , Bash :)

, :

IP /etc/hosts http://jupyter.local:8888
, LXD LXD.
:

! . !

UPDATE: 15.04.2020 18:30 — "Hello, World!"
UPDATE: 16.04.2020 10:00 — JupyterLab
UPDATE: 16.04.2020 10:40 — " "

Launch Jupyter into orbit LXD

Navigation

Plan to take off into orbit ^

^

^

JupyterLab ^

^

Hello, World! ^

Python ^

JupyterLab ^

? ^

More articles: