Hello,
I have a list of filters which are independent one from the other, and right now I am appliying a function to each of this filter sequentially. The function itself, uses some paraview filters BUT at the end of the function it will do some calculations, delete all the filters that were generated during the function itself and return a value, so at the end of the application of the function to each element of the list I get a value for each element, and the pipeline stays the same (as the created in the middle filters were deleted.).
The function uses some filters that are not parallelized by paraview (it is using two, clip and connectivity). as the list of inputs is quite large, I would like to use the different processors or threads on my machine, to do all (or at least a maximum possible number depending on the hardware) calls of this function in parallel. is this something possible to do?
here i give a small clean example for easy coomprehension:
from paraview.simple import *
import gc
from paraview.vtk.numpy_interface import dataset_adapter as dsa
def myFunction(filter):
slice1 = Slice(registrationName='Slice1', Input=filter)
connectivity1=Connectivity(registrationName='Connectivity1', Input=slice1)
UpdatePipeline()
data=dsa.WrapDataObject(servermanager.Fetch(connectivity1))
vals=data.CellData['RegionId'].tolist()
if vals==[] or vals==0:
flag=0
else:
flag=len(set(vals))
for f in [slice1,connectivity1]:
Delete(f)
del f
gc.collect()
return flag
wavelet1 = Wavelet(registrationName='Wavelet1')
UpdatePipeline()
pointDatatoCellData1 = PointDatatoCellData(registrationName='PointDatatoCellData1', Input=wavelet1)
lowers=[ 100, 150,200,250]
uppers=[ 150, 200,250,300]
thresholds=[Threshold(registrationName='Threshold1', Input=pointDatatoCellData1,Scalars = ['CELLS', 'RTData'],LowerThreshold=lowers[n], UpperThreshold=uppers[n]) for n,i in enumerate(lowers)]
thresholdsf=[myFunction(filt) for filt in thresholds]
would it be possible to do the thresholdsf but with multithread/multiprocessor?
I have on the workstation 112 threads and i see my code running in a single one…