kubernetes pods dying

Why are my pods dying?

pods that die:
homlishWeb
jukebox
weather
pods that don't die:
hcr
prometheus & grafana
nginx

Internets seems to blame the logs. My logs seem to indicate a volume mount issue, possibly NFS?

kubernetes upgrade

phomlish@a6:~/kubernetes/dashboard$ find /etc/kubernetes/pki/ -type f -name “*.crt” -print|egrep -v ‘ca.crt$’|xargs -L 1 -t -i bash -c ‘openssl x509 -noout -text -in {}|grep After’
xargs: warning: options –max-lines and –replace/-I/-i are mutually exclusive, ignoring previous –max-lines value
bash -c ‘openssl x509 -noout -text -in /etc/kubernetes/pki/apiserver-etcd-client.crt|grep After’
Not After : Sep 6 11:43:38 2024 GMT
bash -c ‘openssl x509 -noout -text -in /etc/kubernetes/pki/apiserver-kubelet-client.crt|grep After’
Not After : Sep 6 11:43:37 2024 GMT
bash -c ‘openssl x509 -noout -text -in /etc/kubernetes/pki/front-proxy-client.crt|grep After’
Not After : Sep 6 11:43:38 2024 GMT
bash -c ‘openssl x509 -noout -text -in /etc/kubernetes/pki/etcd/peer.crt|grep After’
Not After : Sep 6 11:43:38 2024 GMT
bash -c ‘openssl x509 -noout -text -in /etc/kubernetes/pki/etcd/server.crt|grep After’
Not After : Sep 6 11:43:38 2024 GMT
bash -c ‘openssl x509 -noout -text -in /etc/kubernetes/pki/etcd/healthcheck-client.crt|grep After’
Not After : Sep 6 11:43:38 2024 GMT
bash -c ‘openssl x509 -noout -text -in /etc/kubernetes/pki/apiserver.crt|grep After’
Not After : Sep 6 11:43:37 2024 GMT
phomlish@a6:~/kubernetes/dashboard$

as root:
cd /etc/kubernetes/
mv {admin.conf,controller-manager.conf,kubelet.conf,scheduler.conf} ~/
kubeadm init phase kubeconfig all
reboot
as phomlish:
cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

 

phomlish@a6:~/kubernetes/dashboard$ ./genK8sToken.sh
error: failed to create token: Unauthorized

 

ffmpeg to sound card

I never did figure this out. Maybe ffmpeg needs to be compiled w/ devices

ffmpeg –devices
linux:
[NULL @ 0x3171700] Unable to find a suitable output format for ‘–devices’
–devices: Invalid argument

mac:
[NULL @ 0x7ff53c810600] Unable to find a suitable output format for ‘–devices’
–devices: Invalid argument

icecast2

IPASS=

using ffmpeg
to a7:
ffmpeg -re -ss 19 -i 13.mp3 -f mp3 icecast://source:$IPASS@jukebox.homlish.net:8000/jukebox.mp3

to kubernetes:
ffmpeg -re -ss 19 -i 13.m4a -acodec libmp3lame -ab 32k -ac 1 icecast://source:$IPASS@jplay.homlish.net:8000/live.mp3

to play in browser

using vlc
play to sound card:
/Applications/VLC.app/Contents/MacOS/VLC \
-Idummy –play-and-exit \
/private/nfs/a0/usr4/music/Grateful\ Dead/1990/RFK\ 7\ 12\ 90\ set\ 1/13\ cassidy.m4a

play to icecast2
/Applications/VLC.app/Contents/MacOS/VLC \
-Idummy –play-and-exit \
13.m4a \
:sout=#duplicate{dst=std{access=shout,mux=ogg,dst=source:$IPASS@jplay.homlish.net:8000/live}}

/usr/local/bin/vlc -vvv udp://@224.1.1.105:2105 –sout ‘#transcode{acodec=vorb,ab=128,channels=2}:duplicate{dst=std{access=shout,mux=ogg,dst=source:123456@172.31.0.14:8000/r29}}’

finding Mac sound device
w01:~ phomlish$ system_profiler -listDataTypes | grep -i Audio
SPAudioDataType
w01:~ phomlish$ system_profiler SPAudioDataType
Audio:

Devices:

Built-in Microphone:

Default Input Device: Yes
Input Channels: 2
Manufacturer: Apple Inc.
Current SampleRate: 44100
Transport: Built-in
Input Source: Internal Microphone

Built-in Output:

Default Output Device: Yes
Default System Output Device: Yes
Manufacturer: Apple Inc.
Output Channels: 2
Current SampleRate: 44100
Transport: Built-in
Output Source: Internal Speakers

system_profiler SPAudioDataType -xml
HUGE OUTPUT
TODO:
how can we get liquidsoap to play silence?

a6

Plan: let’s get it back up and running, quickly

SCRAPPED, too complicated setting up a new hard drive

make raid partitions for sde

1 1049kB 540MB 539MB fat32 efi boot, esp
2 540MB 2540MB 2000MB ext4 boot
6 2540MB 20.5GB 18.0GB ext4 root
3 20.5GB 40.5GB 20.0GB ext4 var
4 40.5GB 72.5GB 32.0GB ext4 tmp
5 72.5GB 123GB 50.0GB ext4 home
8 123GB 208GB 85.5GB ext4 primary

parted /dev/sde unit s print free

parted -a optimal /dev/sde
print free
# efi
mkpart primary fat32 1MiB 100MiB
set 1 esp on
# boot
mkpart primary ext4 100MiB 300MiB

mdadm –create /dev/md1 –level=1 –raid-devices=2 missing /dev/sde1 –metadata=0.90
mdadm –create /dev/md2 –level=1 –raid-devices=2 missing /dev/sde2 –metadata=0.90
mdadm –create /dev/md3 –level=1 –raid-devices=2 missing /dev/sde3 –metadata=0.90

md126: efi
md127: boot
mdadm –stop /dev/md125
mdadm –stop /dev/md126
mdadm –stop /dev/md127

grub-install –target=x86_64-efi –efi-directory=ESP_MOUNT_PATH –bootloader-id=grub
/boot/efi/EFI/debian/grubx64.efi
grub-install –target=x86_64-efi –efi-directory=/mnt –bootloader-id=grub
grub-install: error: /usr/lib/grub/x86_64-efi/modinfo.sh doesn’t exist. Please specify –target or –directory.

https://wiki.archlinux.org/title/Convert_a_single_drive_system_to_RAID

phomlish@a6:~$ cat /etc/issue
Debian GNU/Linux 10 \n \l

udev 16G 0 16G 0% /dev
tmpfs 3.2G 16M 3.2G 1% /run
/dev/sda6 17G 5.7G 9.9G 37% /
tmpfs 16G 0 16G 0% /dev/shm
tmpfs 5.0M 8.0K 5.0M 1% /run/lock
tmpfs 16G 0 16G 0% /sys/fs/cgroup
tmpfs 4.0G 0 4.0G 0% /ramdisk
/dev/sda2 1.9G 116M 1.6G 7% /boot
/dev/sdb1 2.7T 275G 2.3T 11% /usr4
/dev/md0 916G 197G 673G 23% /usr3
/dev/sda1 513M 132K 513M 1% /boot/efi
/dev/sda5 46G 1.6G 42G 4% /home
/dev/sda8 78G 752M 74G 1% /usr2
/dev/sda3 19G 13G 5.0G 72% /var
/dev/sda4 30G 45M 28G 1% /tmp
tmpfs 3.2G 4.0K 3.2G 1% /run/user/113

hdparm -I /dev/sda

root@a6:~# parted /dev/sda
GNU Parted 3.2
Using /dev/sda
Welcome to GNU Parted! Type ‘help’ to view a list of commands.
(parted) print
Model: ATA KINGSTON SA400S3 (scsi)
Disk /dev/sda: 240GB
Sector size (logical/physical): 512B/512B
Partition Table: gpt
Disk Flags:

Number Start End Size File system Name Flags
1 1049kB 540MB 539MB fat32 efi boot, esp
2 540MB 2540MB 2000MB ext4 boot
6 2540MB 20.5GB 18.0GB ext4 root
3 20.5GB 40.5GB 20.0GB ext4 var
4 40.5GB 72.5GB 32.0GB ext4 tmp
5 72.5GB 123GB 50.0GB ext4 home
8 123GB 208GB 85.5GB ext4 primary

root@a6:~# parted /dev/sde
GNU Parted 3.2
Using /dev/sde
Welcome to GNU Parted! Type ‘help’ to view a list of commands.
(parted) print
Model: ATA SATA SSD (scsi)
Disk /dev/sde: 120GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Disk Flags:

Number Start End Size Type File system Flags
2 1049kB 20.0GB 20.0GB primary ext4 boot
3 20.0GB 40.0GB 20.0GB primary
4 40.0GB 95.0GB 55.0GB extended
5 40.0GB 55.0GB 15.0GB logical ext4
6 55.0GB 75.0GB 20.0GB logical ext4
7 75.0GB 95.0GB 20.0GB logical ext4
1 112GB 120GB 8000MB primary linux-swap(v1)

root@a6:~# cat /proc/mdstat
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10]
md0 : active raid1 sdc1[0] sdd1[1]
976629760 blocks super 1.2 [2/2] [UU]
bitmap: 0/8 pages [0KB], 65536KB chunk

unused devices:

parted /dev/sdg unit s print free
parted /dev/sdg mklabel gpt

parted -a optimal /dev/sdg mkpart primary 0% 100%

Continue reading “a6”

mariaDB

2022-02-03
The problem: latest java required TLS 1.2

Solution 1: edit java config to allow TLS1.1
issue: everytime we update java we would need to fix the java config

Solution 2: roll my own
failed miserably

Solution 3: install maridb to kubernetes

kmysql.homlish.net 10.11.168.244

had to connect to the pod to create users
CREATE USER ‘phomlish’@’%’ IDENTIFIED BY ‘****’;
GRANT ALL PRIVILEGES ON * . * TO ‘phomlish’@’%’;
FLUSH PRIVILEGES;

Continue reading “mariaDB”

dnla

used by: marantz

dlna

a2:
/usr/sbin/minidlnad
port 8200

DAEMON=/usr/sbin/minidlnad
root@a2:/usr5/videos/mpaa# /usr/sbin/minidlnad -V
Version 1.2.1

https://github.com/nathanaela/minidlna/blob/master/INSTALL.MD

root@a2:~# which minidlnad
/usr/local/sbin/minidlnad

rm /etc/rc0.d/K01minidlna /etc/rc1.d/K01minidlna /etc/rc2.d/S02minidlna /etc/rc3.d/S02minidlna /etc/rc4.d/S02minidlna /etc/rc5.d/S02minidlna /etc/rc6.d/K01minidlna