Python ThreadPoolExecutor 不并行运行

问题描述 投票:0回答:3

Python ThreadPoolExecutor 不是并行运行的,它正在顺序调用立方体方法并等待完成,

我需要运行 20 个并行线程

from concurrent.futures import ThreadPoolExecutor
from time import sleep

def cube(x):
    sleep(2)
    print(f'Cube of {x}:{x*x*x}')

count = 0
while True:
    with ThreadPoolExecutor(max_workers=20) as exe:
        exe.submit(cube,2)
    count += 1
    if count > 50:
        break   
python python-3.x multithreading threadpool python-multithreading
3个回答
1
投票

“with”语句使用ThreadPoolExecutor的__enter__方法,此时初始化线程池。因此,对于线程池中的函数执行,我们应该在“with”语句中使用它。

with ThreadPoolExecutor(max_workers=20) as exe:  # for default it will be number of os.cpu_count()
    futures = []
    for i in range(50):
        futures.append(executor.submit(cube, i))
    for future in concurrent.futures.as_completed(futures):
        print(future.result())

0
投票

我想想要这样的东西:

from concurrent import futures
from time import sleep

THREADS = 20

def cube(x):
    sleep(2)
    res = x*x*x
    print(f'Cube of {x}:{res}')
    return res

with futures.ThreadPoolExecutor(max_workers=THREADS) as exe:
    jobs = {exe.submit(cube, i): i for i in range(THREADS)}

    for job in futures.as_completed(jobs):
        try:
            data = job.result()
        except Exception as exc:
            print('%r generated an exception: %s' % (jobs[job], exc))
        else:
            print(f"Result of thread {jobs[job]}: {data})")

出:

Cube of 2:8
Cube of 1:1
Cube of 3:27
Cube of 0:0
Cube of 4:64
Result of thread 2: 8)
Result of thread 1: 1)
Result of thread 0: 0)
Result of thread 4: 64)
Cube of 5:125
Cube of 6:216
Cube of 8:512
Cube of 14:2744
Cube of 12:1728
Cube of 17:4913
Result of thread 3: 27)
Cube of 13:2197
Cube of 7:343
Cube of 16:4096
Cube of 15:3375
Cube of 18:5832
Cube of 11:1331
Cube of 9:729
Cube of 19:6859
Cube of 10:1000
Result of thread 5: 125)
Result of thread 6: 216)
Result of thread 8: 512)
Result of thread 14: 2744)
Result of thread 12: 1728)
Result of thread 17: 4913)
Result of thread 13: 2197)
Result of thread 7: 343)
Result of thread 16: 4096)
Result of thread 15: 3375)
Result of thread 18: 5832)
Result of thread 11: 1331)
Result of thread 10: 1000)
Result of thread 19: 6859)
Result of thread 9: 729)

0
投票

这可能是您想要实现的目标:

from concurrent.futures import ThreadPoolExecutor
from time import sleep

def cube(x):
    print(f'Starting {x}')
    sleep(2)
    print(f'Cube of {x}:{x*x*x}')

count = []
for i in range (0,50):
    count.append(i)

with ThreadPoolExecutor(max_workers=20) as exe:
    exe.map(cube,count)
© www.soinside.com 2019 - 2024. All rights reserved.