r00t2/aif-ng
1
0
Fork 0
Code Issues Pull Requests Projects Releases Activity
d7d85c7d9d
aif-ng/aif/disk/block_fallback.py

204 lines
9.1 KiB
Python
Raw Normal View History

soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
# To reproduce sgdisk behaviour in v1 of AIF-NG:
# https://gist.github.com/herry13/5931cac426da99820de843477e41e89e
# https://github.com/dcantrell/pyparted/blob/master/examples/query_device_capacity.py
# TODO: Remember to replicate genfstab behaviour.
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
import os
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
import re
try:
# https://stackoverflow.com/a/34812552/733214
# https://github.com/karelzak/util-linux/blob/master/libmount/python/test_mount_context.py#L6
import libmount as mount
except ImportError:
# We should never get here. util-linux is part of core (base) in Arch and uses "libmount".
import pylibmount as mount
##
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
import blkinfo
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
import parted # https://www.gnu.org/software/parted/api/index.html
import psutil
##
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
import aif.constants
import aif.utils
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
# TODO: https://serverfault.com/questions/356534/ssd-erase-block-size-lvm-pv-on-raw-device-alignment
notes
2019-11-05 07:07:16 -05:00
# TODO: caveats? https://gist.github.com/leodutra/8779d468e9062058a3e90008295d3ca6
# https://unix.stackexchange.com/questions/325886/bios-gpt-do-we-need-a-boot-flag
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
class Partition(object):
def __init__(self, part_xml, diskobj, start_sector, partnum, tbltype, part_type = None):
if tbltype not in ('gpt', 'msdos'):
raise ValueError('{0} must be one of gpt or msdos'.format(tbltype))
if tbltype == 'msdos' and part_type not in ('primary', 'extended', 'logical'):
raise ValueError(('You must specify if this is a '
'primary, extended, or logical partition for msdos partition tables'))
self.xml = part_xml
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
self.id = self.xml.attrib['id']
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self.flags = set()
for f in self.xml.findall('partitionFlag'):
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
if f.text in aif.constants.PARTED_FLAGS:
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self.flags.add(f.text)
self.flags = sorted(list(self.flags))
self.partnum = partnum
if tbltype == 'msdos':
if partnum > 4:
self.part_type = parted.PARTITION_LOGICAL
else:
if part_type == 'extended':
self.part_type = parted.PARTITION_EXTENDED
elif part_type == 'logical':
self.part_type = parted.PARTITION_LOGICAL
else:
self.part_type = parted.PARTITION_NORMAL
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
self.fs_type = self.xml.attrib['fsType'].lower()
if self.fs_type not in aif.constants.PARTED_FSTYPES:
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
raise ValueError(('{0} is not a valid partition filesystem type; '
'must be one of: {1}').format(self.xml.attrib['fsType'],
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
', '.join(sorted(aif.constants.PARTED_FSTYPES))))
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self.disk = diskobj
self.device = self.disk.device
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
self.devpath = '{0}{1}'.format(self.device.path, self.partnum)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self.is_hiformatted = False
sizes = {}
for s in ('start', 'stop'):
x = dict(zip(('from_bgn', 'size', 'type'),
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
aif.utils.convertSizeUnit(self.xml.attrib[s])))
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
sectors = x['size']
if x['type'] == '%':
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
sectors = int(self.device.getLength() * (0.01 * x['size']))
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
else:
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
sectors = int(aif.utils.size.convertStorage(x['size'],
x['type'],
target = 'B') / self.device.sectorSize)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
sizes[s] = (sectors, x['from_bgn'])
if sizes['start'][1] is not None:
if sizes['start'][1]:
self.begin = sizes['start'][0] + 0
else:
self.begin = self.device.getLength() - sizes['start'][0]
else:
self.begin = sizes['start'][0] + start_sector
if sizes['stop'][1] is not None:
if sizes['stop'][1]:
self.end = sizes['stop'][0] + 0
else:
# This *technically* should be - 34, at least for gpt, but the alignment optimizer fixes it for us.
self.end = (self.device.getLength() - 1) - sizes['stop'][0]
else:
self.end = self.begin + sizes['stop'][0]
# TECHNICALLY we could craft the Geometry object with "length = ...", but it doesn't let us be explicit
# in configs. So we manually crunch the numbers and do it all at the end.
self.geometry = parted.Geometry(device = self.device,
start = self.begin,
end = self.end)
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
self.filesystem = parted.FileSystem(type = self.fs_type,
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
geometry = self.geometry)
self.partition = parted.Partition(disk = diskobj,
type = self.part_type,
geometry = self.geometry,
fs = self.filesystem)
for f in self.flags[:]:
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
flag_id = aif.constants.PARTED_FLAG_IDX[f]
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
if self.partition.isFlagAvailable(flag_id):
self.partition.setFlag(flag_id)
else:
self.flags.remove(f)
if tbltype == 'gpt' and self.xml.attrib.get('name'):
# The name attribute setting is b0rk3n, so we operate on the underlying PedPartition object.
# https://github.com/dcantrell/pyparted/issues/49#issuecomment-540096687
# https://github.com/dcantrell/pyparted/issues/65
# self.partition.name = self.xml.attrib.get('name')
_pedpart = self.partition.getPedPartition()
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
_pedpart.set_name(self.xml.attrib['name'])
#
# def detect(self):
# pass # TODO; blkinfo?
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
class Disk(object):
def __init__(self, disk_xml):
self.xml = disk_xml
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
self.id = self.xml.attrib['id']
self.devpath = os.path.realpath(self.xml.attrib['device'])
making a LOT of headway on the gi stuff but hitting a namespace issue
2019-11-04 23:18:28 -05:00
self.is_lowformatted = None
self.is_hiformatted = None
self.is_partitioned = None
self.partitions = None
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self._initDisk()
def _initDisk(self):
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
if self.devpath == 'auto':
self.devpath = '/dev/{0}'.format(blkinfo.BlkDiskInfo().get_disks()[0]['kname'])
if not os.path.isfile(self.devpath):
raise ValueError('{0} does not exist; please specify an explicit device path'.format(self.devpath))
self.table_type = self.xml.attrib.get('diskFormat', 'gpt').lower()
if self.table_type in ('bios', 'mbr', 'dos'):
self.table_type = 'msdos'
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
validlabels = parted.getLabels()
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
if self.table_type not in validlabels:
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
raise ValueError(('Disk format {0} is not valid for this architecture;'
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
'must be one of: {1}'.format(self.table_type, ', '.join(list(validlabels)))))
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self.device = parted.getDevice(self.devpath)
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
self.disk = parted.freshDisk(self.device, self.table_type)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self.is_lowformatted = False
self.is_hiformatted = False
self.is_partitioned = False
self.partitions = []
future proofing is good, but... since print() was made a function in py3, i can predict at some point that return will be made a func as well. sure, good. but "return()" *currently* returns an empty tuple. We want to explicitly return None for testing purposes.
2019-12-11 04:33:15 -05:00
return(None)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
def diskFormat(self):
if self.is_lowformatted:
future proofing is good, but... since print() was made a function in py3, i can predict at some point that return will be made a func as well. sure, good. but "return()" *currently* returns an empty tuple. We want to explicitly return None for testing purposes.
2019-12-11 04:33:15 -05:00
return(None)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
# This is a safeguard. We do *not* want to low-format a disk that is mounted.
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
aif.utils.checkMounted(self.devpath)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
self.disk.deleteAllPartitions()
self.disk.commit()
self.is_lowformatted = True
self.is_partitioned = False
future proofing is good, but... since print() was made a function in py3, i can predict at some point that return will be made a func as well. sure, good. but "return()" *currently* returns an empty tuple. We want to explicitly return None for testing purposes.
2019-12-11 04:33:15 -05:00
return(None)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
def getPartitions(self):
# For GPT, this *technically* should be 34 -- or, more precisely, 2048 (see FAQ in manual), but the alignment
# optimizer fixes it for us automatically.
# But for DOS tables, it's required.
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
if self.table_type == 'msdos':
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
start_sector = 2048
else:
start_sector = 0
self.partitions = []
xml_partitions = self.xml.findall('part')
for idx, part in enumerate(xml_partitions):
partnum = idx + 1
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
if self.table_type == 'gpt':
p = Partition(part, self.disk, start_sector, partnum, self.table_type)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
else:
parttype = 'primary'
if len(xml_partitions) > 4:
if partnum == 4:
parttype = 'extended'
elif partnum > 4:
parttype = 'logical'
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
p = Partition(part, self.disk, start_sector, partnum, self.table_type, part_type = parttype)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
start_sector = p.end + 1
self.partitions.append(p)
future proofing is good, but... since print() was made a function in py3, i can predict at some point that return will be made a func as well. sure, good. but "return()" *currently* returns an empty tuple. We want to explicitly return None for testing purposes.
2019-12-11 04:33:15 -05:00
return(None)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
def partFormat(self):
if self.is_partitioned:
future proofing is good, but... since print() was made a function in py3, i can predict at some point that return will be made a func as well. sure, good. but "return()" *currently* returns an empty tuple. We want to explicitly return None for testing purposes.
2019-12-11 04:33:15 -05:00
return(None)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
if not self.is_lowformatted:
self.diskFormat()
# This is a safeguard. We do *not* want to partition a disk that is mounted.
filesystem and mounting done, other minor tweaks. need to do lvm, mdadm, luks
2019-11-06 02:21:04 -05:00
aif.utils.checkMounted(self.devpath)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
if not self.partitions:
self.getPartitions()
if not self.partitions:
future proofing is good, but... since print() was made a function in py3, i can predict at some point that return will be made a func as well. sure, good. but "return()" *currently* returns an empty tuple. We want to explicitly return None for testing purposes.
2019-12-11 04:33:15 -05:00
return(None)
soooo... turns out ALL of the disk operations can be performed with gobject-introspection. BUT it's unlikely that that'll be available everywhere, or that the Arch Linux releng team would include it, etc. So we have fallbacks to mimic it. BUT please try to use gobject-introspection with libblockdev, because it's going to be a lot faster and a lot less error-prone.
2019-11-01 02:54:51 -04:00
for p in self.partitions:
self.disk.addPartition(partition = p, constraint = self.device.optimalAlignedConstraint)
self.disk.commit()
p.devpath = p.partition.path
p.is_hiformatted = True
self.is_partitioned = True
future proofing is good, but... since print() was made a function in py3, i can predict at some point that return will be made a func as well. sure, good. but "return()" *currently* returns an empty tuple. We want to explicitly return None for testing purposes.
2019-12-11 04:33:15 -05:00
return(None)
Reference in New Issue Copy Permalink