Python 3.4 有什麼新功能¶
- 作者:
R. David Murray <rdmurray@bitdance.com> (編輯者)
这篇文章介绍了 Python 3.4 相比 3.3 增加的新特性。 Python 3.4 发布于 2014 年 3 月 16 日。 对于完整的细节,请参见 更新日志。
也參考
PEP 429 -- Python 3.4 发布计划
摘要 - 发布重点¶
新的语法特性:
Python 3.4 中没有增加新的语法特性。
其他的新特性
针对非文本编码格式的 编解码器处理方式的改进 (多个相关问题)。
针对导入系统的 ModuleSpec 类型 (PEP 451)。 (将影响导入器的作者。)
新的库模块:
selectors
: 高层级且高效率的 I/O 复用,在select
模块的基础之上建立(为 PEP 3156 的组成部分)。statistics
: 基础 数字领域稳定统计库 (PEP 450)。
显著改进的库模块:
email
增加新的子模块contentmanager
和新的子类型Message
(EmailMessage
) 用以 简化 MIME 处理 (bpo-18891)。inspect
和pydoc
模块现在能够自省更多种类的可调用对象,这改进了 Pythonhelp()
系统的输出。ipaddress
模块 API 已被声明为稳定状态
安全改进:
将新创建的文件描述符设为不可继承 (PEP 446) 以避免将文件描述符泄露给子进程。
现在
multiprocessing
具有 一个在 Unix 上避免使用 os.fork 的选项。 spawn 和 forkserver 更为安全因为它们会避免与子进程共享数据。在 Windows 上
multiprocessing
子进程将不再继承父进程的所有可继承句柄,而仅继承必需的几个。新增的
hashlib.pbkdf2_hmac()
函数可提供 PKCS#5 基于口令的密钥派生函数 2。在
ssl
中对于 TLSv1.1 和 TLSv1.2 的支持。在
ssl
中对于 从 Windows 系统证书库获取证书的支持。ssl.SSLContext
类具有 大量改进。标准库中所有支持 SSL 的模块现在都支持服务器证书验证,包括主机名匹配 (
ssl.match_hostname()
) 和 CRL (Certificate Revocation Lists,参见ssl.SSLContext.load_verify_locations()
)。
CPython 实现的改进:
通过应用 PEP 442,在大多数情况下 模块的 globals 在最终化期间将不再被设为 None (bpo-18214)。
请继续阅读有关针对用户的改变的完整清单,包括许多其他较小的改进、CPython 优化、弃用以及潜在的移植问题。
新的特性¶
PEP 453: 在 Python 安装版中对 PIP 的显式初始设置¶
默认对 pip 进行初始设置¶
新增的 ensurepip
模块(在 PEP 453 中定义)提供了一个在 Python 安装版和虚拟环境中初始设置 pip 安装器的标准跨平台机制。 包括在 Python 3.4.0 中的 pip
版本是 pip
1.5.4,未来的 3.4.x 维护发布版会将附带版本升级为创建候选发布版时的 pip
最新版本。
在默认情况下,将在所有平台上安装 pipX
和 pipX.Y
等命令(其中 X.Y 表示 Python 安装包的版本),并包括 pip
Python 包及其依赖。 在 Windows 中以及所有平台的虚拟环境中,还将安装不带版本号的 pip
命令。 在其他平台中,系统层级上不带版本号的 pip
命令通常是指向单独安装的 Python 2 版本。
pyvenv
命令行工具和 venv
模块可利用 ensurepip
模块在虚拟环境中准备好 pip
。 当使用命令行工具时,会默认安装 pip
,而当使用 venv
模块的 API 安装版时必须显式地安装 pip
。
对于 CPython 在 POSIX 系统上的源代码编译版,make install
和 make altinstall
命令默认会初始设置 pip
。 此行为可通过配置选项来控制,并通过 Makefile 选项来重写。
在 Windows 和 Mac OS X 上,现在 CPython 安装程序默认会将 pip
与 CPython 本身一同安装(用户可以在安装过程中选择不安装它)。 Window 用户需要选择执行 PATH
修改以使 pip
在命令行中默认可用,在其他情况下它仍然可以通过 Windows 版 Python 启动器以 py -m pip
的方式使用。
正如 在 PEP 中已讨论的,平台打包者可以选择默认不安装这些命令,只需要在它们被发起调用时,能够提供有关如何在该平台上安装它们的简单清晰的指引(通常是使用系统包管理器)。
備註
为了避免同时存在的 Python 2 和 Python 3 安装版之前的冲突,当 ensurepip
被直接发起调用时默认只会初始设置带版本号的 pip3
和 pip3.4
命令 —— 需要添加 --default-pip
选项来请求设置不带版本号的 pip
命令。 pyvenv
和 Windows 安装程序会确保未限定版本的 pip
命令在环境中可用,并且 pip
始终可以通过 -m
选项开关而不是直接发起调用以避免在具有多个 Python 安装版的系统中造成歧义。
文档更改¶
作为此项更改的一部分,文档的 安裝 Python 模組 和 發布 Python 模組 章节已经完全重新设计,快速入门和 FAQ 文档也是如此。 大部分打包指南文档现在都已被移至由 Python Packaging Authority 维护的 Python Packaging User Guide 以及相应的独立项目文档。
However, as this migration is currently still incomplete, the legacy versions of those guides remaining available as 安裝 Python 模組(舊版) and 發布 Python 模組(舊版).
也參考
- PEP 453 -- Python 安装版中对 pip 的显式初始设置
PEP 由Donald Stufft 和 Nick Coghlan 撰写,由 Donald Stufft,Nick Coghlan,Martin von Löwis 和 Ned Deily 实现。
PEP 446: 新创建的文件描述符将设为不可继承¶
PEP 446 将新创建的文件描述符设为 不可继承的。 通常,这就是应用程序所需要的行为:当启动一个新进程时,让当前打开的文件也在新进程里打开可能导致各种难以查找的程序错误以及潜在的安全问题。
不过,也存在一些需要继承行为的情况。 为了支持这些情况,可以使用以下的新增函数和方法:
也參考
- PEP 446 -- 将新创建的文件描述符设为不可继承
由 Victor Stinner 撰寫 PEP 與實作。
编解码器处理方式的改进¶
自首次被引入以来,codecs
模块始终是作为一个类型中立的动态编码和解码系统来运作的。 然而,它与 Python 文本模型,尤其是内置 str
、bytes
和 bytearray
类型上的限定类型的便捷方法的紧密耦合,在历史上掩盖了这一事实。
作为明晰情况的关键一步,现在 codecs.encode()
和 codecs.decode()
便捷函数在 Python 2.7、3.3 和 3.4 中都正确地写入了文档。 自 Python 2.4 以来这些函数即已存在于 codecs
模块中(并已被回归测试套件所覆盖),但在此前只能通过运行时自省才能发现。
不同于 str
, bytes
和 bytearray
上的便捷方法,codecs
的便捷函数同时支持 Python 2 和 Python 3 中的任意编解码器,而非仅限于 Unicode 文本编码格式(在 Python 3 中) 或 basestring
<-> basestring
转换(在 Python 2 中)。
在 Python 3.4 中,解释器能够识别标准库中提供的已知非文本编码格式并会在适当的时候引导用户找到这些通用型便捷函数:
>>> b"abcdef".decode("hex")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
LookupError: 'hex' is not a text encoding; use codecs.decode() to handle arbitrary codecs
>>> "hello".encode("rot13")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
LookupError: 'rot13' is not a text encoding; use codecs.encode() to handle arbitrary codecs
>>> open("foo.txt", encoding="hex")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
LookupError: 'hex' is not a text encoding; use codecs.open() to handle arbitrary codecs
在相关的改变中,只要在不破坏向下兼容性 的情况下是可行的,则在编码和解码操作期间引发的异常都会被包装在一个特定类型的链式异常中,该类型的名称与产生错误的相应编解码器一致:
>>> import codecs
>>> codecs.decode(b"abcdefgh", "hex")
Traceback (most recent call last):
File "/usr/lib/python3.4/encodings/hex_codec.py", line 20, in hex_decode
return (binascii.a2b_hex(input), len(input))
binascii.Error: Non-hexadecimal digit found
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
binascii.Error: decoding with 'hex' codec failed (Error: Non-hexadecimal digit found)
>>> codecs.encode("hello", "bz2")
Traceback (most recent call last):
File "/usr/lib/python3.4/encodings/bz2_codec.py", line 17, in bz2_encode
return (bz2.compress(input), len(input))
File "/usr/lib/python3.4/bz2.py", line 498, in compress
return comp.compress(data) + comp.flush()
TypeError: 'str' does not support the buffer interface
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
TypeError: encoding with 'bz2' codec failed (TypeError: 'str' does not support the buffer interface)
最后,正如上面的例子所示,这些改进允许恢复非 Unicode 编解码器的便捷别名,这些别名在 Python 3.2 中已被恢复。 这意味着(举例来说)二进制数据到其十六进制表示形式的编码转换现在可以写成:
>>> from codecs import encode, decode
>>> encode(b"hello", "hex")
b'68656c6c6f'
>>> decode(b"68656c6c6f", "hex")
b'hello'
在标准库中提供的二进制和文本转换操作详见 二进制转换 和 文字转换。
(由 Nick Coghlan 在 bpo-7475, bpo-17827, bpo-17828 和 bpo-19619 中贡献。)
PEP 451: 针对导入系统的 ModuleSpec 类型¶
PEP 451 提供了对模块相关信息的封装,导入机制将使用这些信息来加载它(即模块规范说明)。 这有助于简化导入的实现和几个导入相关的 API。 这一改动也是 某些未来导入相关改进 的基石。
PEP 中面向公众的修改是完全向下兼容的。 并且,它们应当对除导入器开发者之外的其他所有人都可见。 主要查找器和加载器方法已被弃用,但它们将继续工作。 新的导入器应当使用 PEP 中描述的新方法。 现有的导入器应当被更新以实现这些新方法。 请参阅 弃用 一节获取应当被替代的方法及其替代物的列表。
其他语言特性修改¶
对Python 语言核心进行的小改动:
Unicode 数据库更新至 UCD 版本 6.3。
现在
min()
和max()
均接受一个 default 仅限关键字参数可被用来指定当它们要求值的可迭代对象中没有任何元素时要返回的值。 (由 Julian Berman 在 bpo-18111 中贡献。)模块对象现在是 可弱引用的。
模块的
__file__
属性(以及相关的值)现在应当总是默认包含绝对路径,唯一的例外是当使用相对路径直接执行一个脚本时的__main__.__file__
。 (由 Brett Cannon 在 bpo-18416 中贡献。)现在所有 UTF-* 编解码器(UTF-7 除外)在编码和解码期间都将拒绝替代符除非使用
surrogatepass
错误处理句柄,例外情况有 UTF-16 解码器(接受有效的替代符对)和 UTF-16 编码器(在编码非 BMP 字符时会产生替代符)。 (由 Victor Stinner, Kang-Hao (Kenny) Lu 和 Serhiy Storchaka 在 bpo-12892 中贡献。)新增 German EBCDIC 编解码器
cp273
。 (由 Michael Bierenfeld 和 Andrew Kuchling 在 bpo-1097797 中贡献。)新增 Ukrainian 编解码器
cp1125
。 (由 Serhiy Storchaka 在 bpo-19668 中贡献。)现在
bytes
.join() 和bytearray
.join() 接受任意缓冲区对象作为参数。 (由 Antoine Pitrou 在 bpo-15958 中贡献。)现在
int
构造器接受任何具有__index__
方法的对象作为其 base 参数。 (由 Mark Dickinson 在 bpo-16772 中贡献。)帧对象现在具有
clear()
方法用来从帧中清除所有对局部变量的引用。 (由 Antoine Pitrou 在 bpo-17934 中贡献。)现在
memoryview
被注册为序列
,并支持reversed()
内置函数。 (由 Nick Coghlan 和 Claudiu Popa 在 bpo-18690 和 bpo-19078 中贡献。)作为对引入 Argument Clinic 以及对
inspect
和pydoc
模块的其他修改的结果,在各种场合下由help()
所报告的签名信息已获得修改和提升。现在
__length_hint__()
已成为正式语言规范的一部分 (参见 PEP 424)。 (由 Armin Ronacher 在 bpo-16148 中贡献。)
新模組¶
asyncio¶
新增的 asyncio
模块(在 PEP 3156 中定义)为 Python 提供了一个标准的可插入事件循环模型,在标准库中提供了坚实的异步 IO 支持,并使得其他事件循环的实现与标准库和其他库的相互操作更为容易。
对于 Python 3.4,此模块被视为属于 provisional API。
也參考
- PEP 3156 -- 异步 IO 支持的重启: "asyncio" 模块
由 Guido van Rossum 撰寫 PEP 與帶領實作。
ensurepip¶
新增的 ensurepip
模块是用于 PEP 453 实现的主要基础设施。 在正常情况下最终用户不需要与此模块进行交互,但如果对安装版或虚拟环境的自动初始设置遭到拒绝则可使用它来手动初始设置 pip
。
ensurepip
包括了一个捆绑的 pip
副本,其版本更新时间即 CPython 发布包的第一个候选发布版的发布时间(此规则同样适用于维护发布版和新特性发布版)。 ensurepip
不会访问因特网。 如果安装版可以访问因特网,则在运行 ensurepip
之后可以使用所捆绑的 pip
来将 pip
升级为比所捆绑版本更高的版本。 (请注意这样得到的 pip
升级版本将被视为一个单独安装的软件包并且在 Python 被卸载时将不会被移除。)
该模块被命名为 ensurepip 是因为如果在已安装 pip
的情况下被调用,它将不做任何操作。 它还有一个 --upgrade
选项可以在当前已安装的 pip
版本比所捆绑的副本更旧的情况下安装所捆绑的 pip
副本。
enum¶
新增的 enum
模块(在 PEP 435 中定义)提供了枚举类型的标准实现,允许其他模块(如 socket
等)通过将含义不清晰的整数常量替换为可向下兼容的枚举值来提供更具信息量的错误消息和更好的调试支持。
也參考
- PEP 435 -- 为 Python 标准库增加了 Enum 类型
PEP 由 Barry Warsaw,Eli Bendersky 和 Ethan Furman 撰写 ,由 Ethan Furman 实现。
pathlib¶
新增的 pathlib
模块提供了代表文件系统路径的类,其语义适用于不同的操作系统。 路径类被划分为提供不带 I/O 的纯计算操作的 纯路径,以及继承自纯路径但提供 I/O 操作的 实体路径。
对于 Python 3.4,此模块被视为属于 provisional API。
也參考
- PEP 428 -- pathlib 模块 -- 面向对象的文件系统路径
由 Antoine Pitrou 撰寫 PEP 與實作。
selectors¶
新增的 selectors
模块(作为 PEP 3156 实现的一部分被创建)允许高层级且高效的 I/O 多路复用,它是在 select
模块的基础上构建的。
statistics¶
新增的 statistics
模块(在 PEP 450 中定义)直接在标准库中提供了一些核心统计功能。 该模块支持计算数据系列的平均值、中位数、模式、方差和标准差等。
也參考
- PEP 450 -- 为标准库增加 statistics 模块
由 Steven D'Aprano 撰寫 PEP 與實作
tracemalloc¶
新增的 tracemalloc
模块(在 PEP 454 中定义)是用于追踪由 Python 所分配的内存块的调试工具。 它提供了以下信息:
追踪对象被分配所在的位置
按文件、按行统计python的内存块分配情况: 总大小、块的数量以及块平均大小。
对比两个内存快照的差异,以便排查内存泄漏
也參考
- PEP 454 -- 新增 tracemalloc 模块用于追踪 Python 内存分配
由 Victor Stinner 撰寫 PEP 與實作
改进的模块¶
abc¶
新增的函数 abc.get_cache_token()
可被用来获知何时使得受到对象图改变影响的缓存失效。 (由 Łukasz Langa 在 bpo-16832 中贡献。)
新增的类型 ABC
以 ABCMeta
作为其元类。 使用 ABC
作为基类的效果实际上相当于指定 metaclass=abc.ABCMeta
,但其写法更简单也更易读。 (由 Bruno Dupuis 在 bpo-16049 中贡献。)
aifc¶
现在 getparams()
将返回一个具名元组而不是普通元组。 (由 Claudiu Popa 在 bpo-17818 中贡献。)
现在 aifc.open()
已支持上下文管理协议:当在 with
代码块中使用时,所返回对象的 close()
方法将在代码块结束时被自动调用。 (由 Serhiy Storchacha 在 bpo-16486 中贡献。)
现在 writeframesraw()
和 writeframes()
方法将接受任意 bytes-like object。 (由 Serhiy Storchaka 在 bpo-8311 中贡献。)
argparse¶
现在 FileType
类可接受 encoding 和 errors 参数,它们将被传递给 open()
。 (由 Lucas Maystre 在 bpo-11175 中贡献。)
audioop¶
现在 audioop
可支持 24 位采样。 (由 Serhiy Storchaka 在 bpo-12866 中贡献。)
新增的 byteswap()
函数可将大端序样本转换为小端序,并可反向转换。 (由 Serhiy Storchaka 在 bpo-19641 中贡献。)
所有 audioop
函数现在均接受任意 bytes-like object。 字符串将不被接受:它们在之前也不可用,现在它们将立即引发错误。 (由 Serhiy Storchaka 在 bpo-16685 中贡献。)
base64¶
现在 base64
中的编码和解码函数在之前需要 bytes
或 bytearray
实例的场合下均接受任意 bytes-like object。 (由 Nick Coghlan 在 bpo-17839 中贡献。)
新增的函数 a85encode()
, a85decode()
, b85encode()
以及 b85decode()
分别提供针对 Ascii85
以及 git/mercurial Base85
格式的二进制数据进行编码和解码的能力。 a85
函数具有可被用于使其与 Ascii85
编码格式的变种,包括 Adobe 变种相互兼容的选项。 (由 Martin Morrison, Mercurial 项目, Serhiy Storchaka 和 Antoine Pitrou 在 bpo-17618 中贡献。)
collections¶
现在 ChainMap.new_child()
方法接受一个 m 参数用于指定要向链结构中添加的子映射表。 这允许将现有的映射和/或自定义映射类型用于子映射表。 (由 Vinay Sajip 在 bpo-16613 中贡献。)
colorsys¶
用于 RGB --- YIQ 转换系数的数码位数已被扩展以使其与 FCC NTSC 版本匹配。 结果中的变化应当少于 1% 并可与在其他地方找到的结果更好地匹配。 (由 Brian Landers 和 Serhiy Storchaka 在 bpo-14323 中贡献。)
contextlib¶
新增的 contextlib.suppress
上下文管理器可以帮助澄清故意抑制来自单条语句的异常的代码的意图。 (由 Raymond Hettinger 在 bpo-15806 和 Zero Piraeus 在 bpo-19266 中贡献。)
新增的 contextlib.redirect_stdout()
上下文管理器使得工具脚本能更容易地处理将输出写入 sys.stdout
并且不提供任何重定向选项的不灵活 API。 使用该上下文管理器,可以将 sys.stdout
的输出重定向到任何其他流,或者配合使用 io.StringIO
来重定向到字符串。 后一种方式有时会特别有用,例如写入函数的输出来实现 命令行接口。 由于它会影响 sys.stdout
的全局状态因此只推荐用于工具脚本。 (由 Raymond Hettinger 在 bpo-15805 中贡献。)
contextlib
文档也已获得更新以包括有关仅单用、可重用与可重入上下文管理器之间的区别的 讨论。
dbm¶
现在 dbm.open()
对象已支持上下文管理器协议。 当在 with
语句中使用时,数据库对象的 close
方法将在代码块结束时被自动调用。 (由 Claudiu Popa 和 Nick Coghlan 在 bpo-19282 中贡献。)
dis¶
现在 show_code()
, dis()
, distb()
和 disassemble()
等函数可接受仅限关键字参数 file 来控制其输出的写入目标。
现在 dis
模块是围绕 Instruction
类来构建的,该类以面向对象的访问方式提供对于每个单独字节码操作的细节。
新增的方法 get_instructions()
提供了一个为给定 Python 代码段产生 Instruction 流的迭代器。 这使得现在可以编写以不同于由 dis
模块本身所提供的方式检查和操纵字节码对象的程序。 例如:
>>> import dis
>>> for instr in dis.get_instructions(lambda x: x + 1):
... print(instr.opname)
LOAD_FAST
LOAD_CONST
BINARY_ADD
RETURN_VALUE
dis
模块中的各种显示工具已被重新编写以使用这些新组件。
此外,新增的对应用程序友好的类 Bytecode
提供了一个面向对象的 API 用于以人类可读的形式检查字节码并对指令进行迭代。 Bytecode
构造器接受与 get_instruction()
相同的参数(外加一个可选的 current_offset 参数),其结果对象可被迭代以产生 Instruction
对象。 但它还有一个 dis
方法,相当于在构造器参数上调用 dis
,但是返回一个多行字符串:
>>> bytecode = dis.Bytecode(lambda x: x + 1, current_offset=3)
>>> for instr in bytecode:
... print('{} ({})'.format(instr.opname, instr.opcode))
LOAD_FAST (124)
LOAD_CONST (100)
BINARY_ADD (23)
RETURN_VALUE (83)
>>> bytecode.dis().splitlines()
[' 1 0 LOAD_FAST 0 (x)',
' --> 3 LOAD_CONST 1 (1)',
' 6 BINARY_ADD',
' 7 RETURN_VALUE']
Bytecode
还有一个类方法 from_traceback()
,它提供了操纵回溯对象的能力(也就是说,print(Bytecode.from_traceback(tb).dis())
等价于 distb(tb)
。)
(由 Nick Coghlan, Ryan Kelly 和 Thomas Kluyver 在 bpo-11816 并由 Claudiu Popa 在 bpo-17916 中贡献。)
新增的函数 stack_effect()
可在给定操作码和参数的 Python 栈上计算其效果,相关信息是无法以其他方式获得的。 (由 Larry Hastings 在 bpo-19722 中贡献。)
doctest¶
新增的 选项旗标 FAIL_FAST
将在检测到首次失败时暂停测试运行。 (由 R. David Murray 和 Daniel Urban 在 bpo-16522 中贡献。)
现在 doctest
的命令行接口使用 argparse
,并新增了两个选项 -o
和 -f
。 -o
允许在命令行中指定 doctest 选项,而 -f
是 -o FAIL_FAST
的简写形式(与 unittest
CLI 所支持的类似选项相对应)。 (由 R. David Murray 在 bpo-11390 中贡献。)
doctest
will now find doctests in extension module __doc__
strings.
(Contributed by Zachary Ware in bpo-3158.)
email¶
as_string()
now accepts a policy argument to
override the default policy of the message when generating a string
representation of it. This means that as_string
can now be used in more
circumstances, instead of having to create and use a generator
in
order to pass formatting parameters to its flatten
method. (Contributed by
R. David Murray in bpo-18600.)
New method as_bytes()
added to produce a bytes
representation of the message in a fashion similar to how as_string
produces a string representation. It does not accept the maxheaderlen
argument, but does accept the unixfrom and policy arguments. The
Message
__bytes__()
method
calls it, meaning that bytes(mymsg)
will now produce the intuitive
result: a bytes object containing the fully formatted message. (Contributed
by R. David Murray in bpo-18600.)
The Message.set_param()
message now accepts a replace keyword argument.
When specified, the associated header will be updated without changing
its location in the list of headers. For backward compatibility, the default
is False
. (Contributed by R. David Murray in bpo-18891.)
A pair of new subclasses of Message
have been added
(EmailMessage
and MIMEPart
), along with a new sub-module,
contentmanager
and a new policy
attribute
content_manager
. All documentation is
currently in the new module, which is being added as part of email's new
provisional API. These classes provide a number of new methods that
make extracting content from and inserting content into email messages much
easier. For details, see the contentmanager
documentation and
the email: 示例. These API additions complete the
bulk of the work that was planned as part of the email6 project. The currently
provisional API is scheduled to become final in Python 3.5 (possibly with a few
minor additions in the area of error handling). (Contributed by R. David
Murray in bpo-18891.)
filecmp¶
A new clear_cache()
function provides the ability to clear the
filecmp
comparison cache, which uses os.stat()
information to
determine if the file has changed since the last compare. This can be used,
for example, if the file might have been changed and re-checked in less time
than the resolution of a particular filesystem's file modification time field.
(Contributed by Mark Levitt in bpo-18149.)
New module attribute DEFAULT_IGNORES
provides the list of
directories that are used as the default value for the ignore parameter of
the dircmp()
function. (Contributed by Eli Bendersky in
bpo-15442.)
functools¶
The new partialmethod()
descriptor brings partial argument
application to descriptors, just as partial()
provides
for normal callables. The new descriptor also makes it easier to get
arbitrary callables (including partial()
instances)
to behave like normal instance methods when included in a class definition.
(Contributed by Alon Horev and Nick Coghlan in bpo-4331.)
The new singledispatch()
decorator brings support for
single-dispatch generic functions to the Python standard library. Where
object oriented programming focuses on grouping multiple operations on a
common set of data into a class, a generic function focuses on grouping
multiple implementations of an operation that allows it to work with
different kinds of data.
也參考
- PEP 443 -- 单分派泛型函数
由 Łukasz Langa 撰寫 PEP 與實作。
现在 total_ordering()
支持从下层的比较函数返回 NotImplemented
作为返回值。 (由 Katie Miller 在 bpo-10042 中贡献。)
现在标准库中增加了 partial()
函数的纯 Python 版本;在 CPython 中它会被 C 加速版本覆盖,但它以供其他实现来使用。 (由 Brian Thorne 在 bpo-12428 中贡献。)
gc¶
新增的函数 get_stats()
可返回由三个单独生成字典组成的列表,每个字典均包含自解释器启动以来收集的统计信息。 (由 Antoine Pitrou 在 bpo-16351 中贡献。)
glob¶
新增函数 escape()
提供了为文件名中的特殊字符进行转义的方式以使它们不会成为 glob 扩展的组成部分而是按字面值来匹配。 (由 Serhiy Storchaka 在 bpo-8402 中贡献。)
hashlib¶
A new hashlib.pbkdf2_hmac()
function provides
the PKCS#5 password-based key derivation function 2. (Contributed by Christian
Heimes in bpo-18582.)
The name
attribute of hashlib
hash objects is now
a formally supported interface. It has always existed in CPython's
hashlib
(although it did not return lower case names for all supported
hashes), but it was not a public interface and so some other Python
implementations have not previously supported it. (Contributed by Jason R.
Coombs in bpo-18532.)
hmac¶
hmac
now accepts bytearray
as well as bytes
for the key
argument to the new()
function, and the msg parameter to both the
new()
function and the update()
method now
accepts any type supported by the hashlib
module. (Contributed
by Jonas Borgström in bpo-18240.)
The digestmod argument to the hmac.new()
function may now be any hash
digest name recognized by hashlib
. In addition, the current behavior in
which the value of digestmod defaults to MD5
is deprecated: in a
future version of Python there will be no default value. (Contributed by
Christian Heimes in bpo-17276.)
With the addition of block_size
and name
attributes (and the formal documentation of the digest_size
attribute), the hmac
module now conforms fully to the PEP 247 API.
(Contributed by Christian Heimes in bpo-18775.)
html¶
New function unescape()
function converts HTML5 character references to
the corresponding Unicode characters. (Contributed by Ezio Melotti in
bpo-2927.)
HTMLParser
accepts a new keyword argument
convert_charrefs that, when True
, automatically converts all character
references. For backward-compatibility, its value defaults to False
, but
it will change to True
in a future version of Python, so you are invited to
set it explicitly and update your code to use this new feature. (Contributed
by Ezio Melotti in bpo-13633.)
The strict argument of HTMLParser
is now deprecated.
(Contributed by Ezio Melotti in bpo-15114.)
http¶
send_error()
now accepts an
optional additional explain parameter which can be used to provide an
extended error description, overriding the hardcoded default if there is one.
This extended error description will be formatted using the
error_message_format
attribute and sent as the body
of the error response. (Contributed by Karl Cow in bpo-12921.)
The http.server
command line interface now has
a -b/--bind
option that causes the server to listen on a specific address.
(Contributed by Malte Swart in bpo-17764.)
idlelib 与 IDLE¶
由于 idlelib 实现了 IDLE 命令行界面和编辑器且不应被其他程序导入,它将随每个发布版获得改进。 请参阅 Lib/idlelib/NEWS.txt
查看 3.3.0 以来的累积变化列表,以及未来 3.4.x 发布版即将发生的变化。 此文件也可通过 IDLE 对话框来查看。
importlib¶
InspectLoader
ABC 定义了一个新方法 source_to_code()
,它接受源数据和一个路径并返回一个代码对象。 其默认实现等价于 compile(data, path, 'exec', dont_inherit=True)
。 (由 Eric Snow 和 Brett Cannon 在 bpo-15627 中贡献。)
现在 InspectLoader
也具有 get_code()
方法的默认实现。 不过,出于性能原因通常需要重写默认实现。 (由 Brett Cannon 在 bpo-18072 中贡献。)
The reload()
function has been moved from imp
to
importlib
as part of the imp
module deprecation. (Contributed by
Berker Peksag in bpo-18193.)
importlib.util
now has a MAGIC_NUMBER
attribute
providing access to the bytecode version number. This replaces the
get_magic()
function in the deprecated imp
module.
(Contributed by Brett Cannon in bpo-18192.)
New importlib.util
functions cache_from_source()
and source_from_cache()
replace the same-named functions
in the deprecated imp
module. (Contributed by Brett Cannon in
bpo-18194.)
The importlib
bootstrap NamespaceLoader
now conforms to
the InspectLoader
ABC, which means that runpy
and
python -m
can now be used with namespace packages. (Contributed
by Brett Cannon in bpo-18058.)
importlib.util
has a new function decode_source()
that decodes source from bytes using universal newline processing. This is
useful for implementing InspectLoader.get_source()
methods.
importlib.machinery.ExtensionFileLoader
now has a
get_filename()
method. This was
inadvertently omitted in the original implementation. (Contributed by Eric
Snow in bpo-19152.)
inspect¶
The inspect
module now offers a basic command line interface to quickly display source code and other
information for modules, classes and functions. (Contributed by Claudiu Popa
and Nick Coghlan in bpo-18626.)
unwrap()
makes it easy to unravel wrapper function chains
created by functools.wraps()
(and any other API that sets the
__wrapped__
attribute on a wrapper function). (Contributed by
Daniel Urban, Aaron Iles and Nick Coghlan in bpo-13266.)
As part of the implementation of the new enum
module, the
inspect
module now has substantially better support for custom
__dir__
methods and dynamic class attributes provided through
metaclasses. (Contributed by Ethan Furman in bpo-18929 and
bpo-19030.)
getfullargspec()
and getargspec()
now use the signature()
API. This allows them to
support a much broader range of callables, including those with
__signature__
attributes, those with metadata provided by argument
clinic, functools.partial()
objects and more. Note that, unlike
signature()
, these functions still ignore __wrapped__
attributes, and report the already bound first argument for bound methods,
so it is still necessary to update your code to use
signature()
directly if those features are desired.
(Contributed by Yury Selivanov in bpo-17481.)
signature()
now supports duck types of CPython functions,
which adds support for functions compiled with Cython. (Contributed
by Stefan Behnel and Yury Selivanov in bpo-17159.)
ipaddress¶
ipaddress
was added to the standard library in Python 3.3 as a
provisional API. With the release of Python 3.4, this qualification
has been removed: ipaddress
is now considered a stable API, covered
by the normal standard library requirements to maintain backwards
compatibility.
A new is_global
property is True
if
an address is globally routeable. (Contributed by Peter Moody in
bpo-17400.)
logging¶
The TimedRotatingFileHandler
has a new atTime
parameter that can be used to specify the time of day when rollover should
happen. (Contributed by Ronald Oussoren in bpo-9556.)
SocketHandler
and
DatagramHandler
now support Unix domain sockets (by
setting port to None
). (Contributed by Vinay Sajip in commit
ce46195b56a9.)
fileConfig()
now accepts a
configparser.RawConfigParser
subclass instance for the fname
parameter. This facilitates using a configuration file when logging
configuration is just a part of the overall application configuration, or where
the application modifies the configuration before passing it to
fileConfig()
. (Contributed by Vinay Sajip in
bpo-16110.)
Logging configuration data received from a socket via the
logging.config.listen()
function can now be validated before being
processed by supplying a verification function as the argument to the new
verify keyword argument. (Contributed by Vinay Sajip in bpo-15452.)
marshal¶
The default marshal
version has been bumped to 3. The code implementing
the new version restores the Python2 behavior of recording only one copy of
interned strings and preserving the interning on deserialization, and extends
this "one copy" ability to any object type (including handling recursive
references). This reduces both the size of .pyc
files and the amount of
memory a module occupies in memory when it is loaded from a .pyc
(or
.pyo
) file. (Contributed by Kristján Valur Jónsson in bpo-16475,
with additional speedups by Antoine Pitrou in bpo-19219.)
mmap¶
mmap objects are now weakly referenceable. (Contributed by Valerie Lambert in bpo-4885.)
multiprocessing¶
On Unix two new start methods,
spawn
and forkserver
, have been added for starting processes using
multiprocessing
. These make the mixing of processes with threads more
robust, and the spawn
method matches the semantics that multiprocessing has
always used on Windows. New function
get_all_start_methods()
reports all start methods
available on the platform, get_start_method()
reports
the current start method, and set_start_method()
sets
the start method. (Contributed by Richard Oudkerk in bpo-8713.)
multiprocessing
also now has the concept of a context
, which
determines how child processes are created. New function
get_context()
returns a context that uses a specified
start method. It has the same API as the multiprocessing
module itself,
so you can use it to create Pool
s and other
objects that will operate within that context. This allows a framework and an
application or different parts of the same application to use multiprocessing
without interfering with each other. (Contributed by Richard Oudkerk in
bpo-18999.)
Except when using the old fork start method, child processes no longer inherit unneeded handles/file descriptors from their parents (part of bpo-8713).
multiprocessing
now relies on runpy
(which implements the
-m
switch) to initialise __main__
appropriately in child processes
when using the spawn
or forkserver
start methods. This resolves some
edge cases where combining multiprocessing, the -m
command line switch,
and explicit relative imports could cause obscure failures in child
processes. (Contributed by Nick Coghlan in bpo-19946.)
operator¶
New function length_hint()
provides an implementation of the
specification for how the __length_hint__()
special method should
be used, as part of the PEP 424 formal specification of this language
feature. (Contributed by Armin Ronacher in bpo-16148.)
There is now a pure-python version of the operator
module available for
reference and for use by alternate implementations of Python. (Contributed by
Zachary Ware in bpo-16694.)
os¶
There are new functions to get and set the inheritable flag of a file descriptor (os.get_inheritable()
,
os.set_inheritable()
) or a Windows handle
(os.get_handle_inheritable()
, os.set_handle_inheritable()
).
New function cpu_count()
reports the number of CPUs available on the
platform on which Python is running (or None
if the count can't be
determined). The multiprocessing.cpu_count()
function is now implemented
in terms of this function). (Contributed by Trent Nelson, Yogesh Chaudhari,
Victor Stinner, and Charles-François Natali in bpo-17914.)
os.path.samestat()
is now available on the Windows platform (and the
os.path.samefile()
implementation is now shared between Unix and
Windows). (Contributed by Brian Curtin in bpo-11939.)
os.path.ismount()
now recognizes volumes mounted below a drive
root on Windows. (Contributed by Tim Golden in bpo-9035.)
os.open()
supports two new flags on platforms that provide them,
O_PATH
(un-opened file descriptor), and O_TMPFILE
(unnamed temporary file; as of 3.4.0 release available only on Linux systems
with a kernel version of 3.11 or newer that have uapi headers). (Contributed
by Christian Heimes in bpo-18673 and Benjamin Peterson, respectively.)
pdb¶
pdb
has been enhanced to handle generators, yield
, and
yield from
in a more useful fashion. This is especially helpful when
debugging asyncio
based programs. (Contributed by Andrew Svetlov and
Xavier de Gaye in bpo-16596.)
The print
command has been removed from pdb
, restoring access to the
Python print()
function from the pdb command line. Python2's pdb
did
not have a print
command; instead, entering print
executed the
print
statement. In Python3 print
was mistakenly made an alias for the
pdb p
command. p
, however, prints the repr
of its argument,
not the str
like the Python2 print
command did. Worse, the Python3
pdb print
command shadowed the Python3 print
function, making it
inaccessible at the pdb
prompt. (Contributed by Connor Osborn in
bpo-18764.)
pickle¶
pickle
now supports (but does not use by default) a new pickle protocol,
protocol 4. This new protocol addresses a number of issues that were present
in previous protocols, such as the serialization of nested classes, very large
strings and containers, and classes whose __new__()
method takes
keyword-only arguments. It also provides some efficiency improvements.
也參考
- PEP 3154 -- pickle 协议 4
由 Antoine Pitrou 撰寫 PEP、Alexandre Vassalotti 實作。
plistlib¶
plistlib
now has an API that is similar to the standard pattern for
stdlib serialization protocols, with new load()
,
dump()
, loads()
, and dumps()
functions. (The older API is now deprecated.) In addition to the already
supported XML plist format (FMT_XML
), it also now supports
the binary plist format (FMT_BINARY
). (Contributed by Ronald
Oussoren and others in bpo-14455.)
poplib¶
Two new methods have been added to poplib
: capa()
,
which returns the list of capabilities advertised by the POP server, and
stls()
, which switches a clear-text POP3 session into an
encrypted POP3 session if the POP server supports it. (Contributed by Lorenzo
Catucci in bpo-4473.)
pprint¶
The pprint
module's PrettyPrinter
class and its
pformat()
, and pprint()
functions have a new
option, compact, that controls how the output is formatted. Currently
setting compact to True
means that sequences will be printed with as many
sequence elements as will fit within width on each (indented) line.
(Contributed by Serhiy Storchaka in bpo-19132.)
Long strings are now wrapped using Python's normal line continuation syntax. (Contributed by Antoine Pitrou in bpo-17150.)
pty¶
现在 pty.spawn()
将返回来自子进程上 os.waitpid()
的状态值,而不是 None
。 (由 Gregory P. Smith 贡献。)
pydoc¶
现在 pydoc
模块是直接基于 inspect.signature()
内省 API,这允许它提供更多可调用对象的签名信息。 这一改变也意味着现在当显示帮助信息时 __wrapped__
属性也会被纳入考虑。 (由 Larry Hastings 在 bpo-19674 中贡献。)
pydoc
模块将不再显示已绑定方法的 self
形参。 现在,它总是会显示所提供可调用对象实际的当前签名。 (由 Larry Hastings 在 bpo-20710 中贡献。)
除了 pydoc
已有的直接修改,它对自定义 __dir__
方法和各种描述器行为的处理也通过对下层 inspect
模块的修改获得了显著的改进。
re¶
New fullmatch()
function and regex.fullmatch()
method anchor
the pattern at both ends of the string to match. This provides a way to be
explicit about the goal of the match, which avoids a class of subtle bugs where
$
characters get lost during code changes or the addition of alternatives
to an existing regular expression. (Contributed by Matthew Barnett in
bpo-16203.)
The repr of regex objects now includes the pattern and the flags; the repr of match objects now includes the start, end, and the part of the string that matched. (Contributed by Hugo Lopes Tavares and Serhiy Storchaka in bpo-13592 and bpo-17087.)
resource¶
New prlimit()
function, available on Linux platforms with a
kernel version of 2.6.36 or later and glibc of 2.13 or later, provides the
ability to query or set the resource limits for processes other than the one
making the call. (Contributed by Christian Heimes in bpo-16595.)
On Linux kernel version 2.6.36 or later, there are also some new
Linux specific constants: RLIMIT_MSGQUEUE
,
RLIMIT_NICE
, RLIMIT_RTPRIO
,
RLIMIT_RTTIME
, and RLIMIT_SIGPENDING
.
(Contributed by Christian Heimes in bpo-19324.)
On FreeBSD version 9 and later, there some new FreeBSD specific constants:
RLIMIT_SBSIZE
, RLIMIT_SWAP
, and
RLIMIT_NPTS
. (Contributed by Claudiu Popa in
bpo-19343.)
select¶
epoll
objects now support the context management protocol.
When used in a with
statement, the close()
method will be called automatically at the end of the block. (Contributed
by Serhiy Storchaka in bpo-16488.)
devpoll
objects now have fileno()
and
close()
methods, as well as a new attribute
closed
. (Contributed by Victor Stinner in
bpo-18794.)
shelve¶
Shelf
instances may now be used in with
statements,
and will be automatically closed at the end of the with
block.
(Contributed by Filip Gruszczyński in bpo-13896.)
shutil¶
copyfile()
now raises a specific Error
subclass,
SameFileError
, when the source and destination are the same
file, which allows an application to take appropriate action on this specific
error. (Contributed by Atsuo Ishimoto and Hynek Schlawack in
bpo-1492704.)
smtpd¶
The SMTPServer
and SMTPChannel
classes now
accept a map keyword argument which, if specified, is passed in to
asynchat.async_chat
as its map argument. This allows an application
to avoid affecting the global socket map. (Contributed by Vinay Sajip in
bpo-11959.)
smtplib¶
SMTPException
is now a subclass of OSError
, which allows
both socket level errors and SMTP protocol level errors to be caught in one
try/except statement by code that only cares whether or not an error occurred.
(Contributed by Ned Jackson Lovely in bpo-2118.)
socket¶
现在 socket 模块会在受支持的平台上支持 CAN_BCM
协议。 (由 Brian Thorne 在 bpo-15359 中贡献。)
Socket 对象新增了用于获取或设置其 可继承旗标 的方法,get_inheritable()
和 set_inheritable()
。
The socket.AF_*
and socket.SOCK_*
constants are now enumeration values
using the new enum
module. This allows meaningful names to be printed
during debugging, instead of integer "magic numbers".
The AF_LINK
constant is now available on BSD and OSX.
inet_pton()
and inet_ntop()
are now supported
on Windows. (Contributed by Atsuo Ishimoto in bpo-7171.)
sqlite3¶
A new boolean parameter to the connect()
function, uri, can be
used to indicate that the database parameter is a uri
(see the SQLite
URI documentation). (Contributed by poq in
bpo-13773.)
ssl¶
PROTOCOL_TLSv1_1
and PROTOCOL_TLSv1_2
(TLSv1.1 and
TLSv1.2 support) have been added; support for these protocols is only available if
Python is linked with OpenSSL 1.0.1 or later. (Contributed by Michele Orrù and
Antoine Pitrou in bpo-16692.)
New function create_default_context()
provides a standard way to
obtain an SSLContext
whose settings are intended to be a
reasonable balance between compatibility and security. These settings are
more stringent than the defaults provided by the SSLContext
constructor, and may be adjusted in the future, without prior deprecation, if
best-practice security requirements change. The new recommended best
practice for using stdlib libraries that support SSL is to use
create_default_context()
to obtain an SSLContext
object, modify it if needed, and then pass it as the context argument
of the appropriate stdlib API. (Contributed by Christian Heimes
in bpo-19689.)
SSLContext
method load_verify_locations()
accepts a new optional argument cadata, which can be used to provide PEM or
DER encoded certificates directly via strings or bytes, respectively.
(Contributed by Christian Heimes in bpo-18138.)
New function get_default_verify_paths()
returns
a named tuple of the paths and environment variables that the
set_default_verify_paths()
method uses to set
OpenSSL's default cafile
and capath
. This can be an aid in
debugging default verification issues. (Contributed by Christian Heimes
in bpo-18143.)
SSLContext
has a new method,
cert_store_stats()
, that reports the number of loaded
X.509
certs, X.509 CA
certs, and certificate revocation lists
(crl
s), as well as a get_ca_certs()
method that
returns a list of the loaded CA
certificates. (Contributed by Christian
Heimes in bpo-18147.)
If OpenSSL 0.9.8 or later is available, SSLContext
has a new
attribute verify_flags
that can be used to control the
certificate verification process by setting it to some combination of the new
constants VERIFY_DEFAULT
, VERIFY_CRL_CHECK_LEAF
,
VERIFY_CRL_CHECK_CHAIN
, or VERIFY_X509_STRICT
.
OpenSSL does not do any CRL verification by default. (Contributed by
Christien Heimes in bpo-8813.)
New SSLContext
method load_default_certs()
loads a set of default "certificate authority" (CA) certificates from default
locations, which vary according to the platform. It can be used to load both
TLS web server authentication certificates
(purpose=
SERVER_AUTH
) for a client to use to verify a
server, and certificates for a server to use in verifying client certificates
(purpose=
CLIENT_AUTH
). (Contributed by Christian
Heimes in bpo-19292.)
Two new windows-only functions, enum_certificates()
and
enum_crls()
provide the ability to retrieve certificates,
certificate information, and CRLs from the Windows cert store. (Contributed
by Christian Heimes in bpo-17134.)
Support for server-side SNI (Server Name Indication) using the new
ssl.SSLContext.set_servername_callback()
method.
(Contributed by Daniel Black in bpo-8109.)
The dictionary returned by SSLSocket.getpeercert()
contains additional
X509v3
extension items: crlDistributionPoints
, calIssuers
, and
OCSP
URIs. (Contributed by Christian Heimes in bpo-18379.)
stat¶
The stat
module is now backed by a C implementation in _stat
. A C
implementation is required as most of the values aren't standardized and
are platform-dependent. (Contributed by Christian Heimes in bpo-11016.)
The module supports new ST_MODE
flags, S_IFDOOR
,
S_IFPORT
, and S_IFWHT
. (Contributed by
Christian Hiemes in bpo-11016.)
struct¶
New function iter_unpack
and a new
struct.Struct.iter_unpack()
method on compiled formats provide streamed
unpacking of a buffer containing repeated instances of a given format of data.
(Contributed by Antoine Pitrou in bpo-17804.)
subprocess¶
check_output()
now accepts an input argument that can
be used to provide the contents of stdin
for the command that is run.
(Contributed by Zack Weinberg in bpo-16624.)
getstatus()
and getstatusoutput()
now
work on Windows. This change was actually inadvertently made in 3.3.4.
(Contributed by Tim Golden in bpo-10197.)
sunau¶
The getparams()
method now returns a namedtuple rather than a
plain tuple. (Contributed by Claudiu Popa in bpo-18901.)
sunau.open()
now supports the context management protocol: when used in a
with
block, the close
method of the returned object will be
called automatically at the end of the block. (Contributed by Serhiy Storchaka
in bpo-18878.)
AU_write.setsampwidth()
now supports 24 bit samples, thus adding
support for writing 24 sample using the module. (Contributed by
Serhiy Storchaka in bpo-19261.)
The writeframesraw()
and
writeframes()
methods now accept any bytes-like
object. (Contributed by Serhiy Storchaka in bpo-8311.)
sys¶
New function sys.getallocatedblocks()
returns the current number of
blocks allocated by the interpreter. (In CPython with the default
--with-pymalloc
setting, this is allocations made through the
PyObject_Malloc()
API.) This can be useful for tracking memory leaks,
especially if automated via a test suite. (Contributed by Antoine Pitrou
in bpo-13390.)
When the Python interpreter starts in interactive mode, it checks for an __interactivehook__
attribute
on the sys
module. If the attribute exists, its value is called with no
arguments just before interactive mode is started. The check is made after the
PYTHONSTARTUP
file is read, so it can be set there. The site
module sets it to a function that enables tab
completion and history saving (in ~/.python-history
) if the platform
supports readline
. If you do not want this (new) behavior, you can
override it in PYTHONSTARTUP
, sitecustomize
, or
usercustomize
by deleting this attribute from sys
(or setting it
to some other callable). (Contributed by Éric Araujo and Antoine Pitrou in
bpo-5845.)
tarfile¶
The tarfile
module now supports a simple 命令行接口 when
called as a script directly or via -m
. This can be used to create and
extract tarfile archives. (Contributed by Berker Peksag in bpo-13477.)
textwrap¶
The TextWrapper
class has two new attributes/constructor
arguments: max_lines
, which limits the number of
lines in the output, and placeholder
, which is a
string that will appear at the end of the output if it has been truncated
because of max_lines. Building on these capabilities, a new convenience
function shorten()
collapses all of the whitespace in the input
to single spaces and produces a single line of a given width that ends with
the placeholder (by default, [...]
). (Contributed by Antoine Pitrou and
Serhiy Storchaka in bpo-18585 and bpo-18725.)
threading¶
The Thread
object representing the main thread can be
obtained from the new main_thread()
function. In normal
conditions this will be the thread from which the Python interpreter was
started. (Contributed by Andrew Svetlov in bpo-18882.)
traceback¶
A new traceback.clear_frames()
function takes a traceback object
and clears the local variables in all of the frames it references,
reducing the amount of memory consumed. (Contributed by Andrew Kuchling in
bpo-1565525.)
types¶
A new DynamicClassAttribute()
descriptor provides a way to define
an attribute that acts normally when looked up through an instance object, but
which is routed to the class __getattr__
when looked up through the
class. This allows one to have properties active on a class, and have virtual
attributes on the class with the same name (see Enum
for an example).
(Contributed by Ethan Furman in bpo-19030.)
urllib¶
urllib.request
now supports data:
URLs via the
DataHandler
class. (Contributed by Mathias Panzenböck
in bpo-16423.)
The http method that will be used by a Request
class
can now be specified by setting a method
class attribute on the subclass. (Contributed by Jason R Coombs in
bpo-18978.)
Request
objects are now reusable: if the
full_url
or data
attributes are modified, all relevant internal properties are updated. This
means, for example, that it is now possible to use the same
Request
object in more than one
OpenerDirector.open()
call with different data arguments, or to
modify a Request
's url
rather than recomputing it
from scratch. There is also a new
remove_header()
method that can be used to remove
headers from a Request
. (Contributed by Alexey
Kachayev in bpo-16464, Daniel Wozniak in bpo-17485, and Damien Brecht
and Senthil Kumaran in bpo-17272.)
HTTPError
objects now have a
headers
attribute that provides access to the
HTTP response headers associated with the error. (Contributed by
Berker Peksag in bpo-15701.)
unittest¶
The TestCase
class has a new method,
subTest()
, that produces a context manager whose
with
block becomes a "sub-test". This context manager allows a test
method to dynamically generate subtests by, say, calling the subTest
context manager inside a loop. A single test method can thereby produce an
indefinite number of separately identified and separately counted tests, all of
which will run even if one or more of them fail. For example:
class NumbersTest(unittest.TestCase):
def test_even(self):
for i in range(6):
with self.subTest(i=i):
self.assertEqual(i % 2, 0)
will result in six subtests, each identified in the unittest verbose output
with a label consisting of the variable name i
and a particular value for
that variable (i=0
, i=1
, etc). See 使用子测试区分测试迭代 for the full
version of this example. (Contributed by Antoine Pitrou in bpo-16997.)
unittest.main()
now accepts an iterable of test names for
defaultTest, where previously it only accepted a single test name as a
string. (Contributed by Jyrki Pulliainen in bpo-15132.)
If SkipTest
is raised during test discovery (that is, at the
module level in the test file), it is now reported as a skip instead of an
error. (Contributed by Zach Ware in bpo-16935.)
discover()
now sorts the discovered files to provide
consistent test ordering. (Contributed by Martin Melin and Jeff Ramnani in
bpo-16709.)
TestSuite
now drops references to tests as soon as the test
has been run, if the test is successful. On Python interpreters that do
garbage collection, this allows the tests to be garbage collected if nothing
else is holding a reference to the test. It is possible to override this
behavior by creating a TestSuite
subclass that defines a
custom _removeTestAtIndex
method. (Contributed by Tom Wardill, Matt
McClure, and Andrew Svetlov in bpo-11798.)
A new test assertion context-manager, assertLogs()
,
will ensure that a given block of code emits a log message using the
logging
module. By default the message can come from any logger and
have a priority of INFO
or higher, but both the logger name and an
alternative minimum logging level may be specified. The object returned by the
context manager can be queried for the LogRecord
s and/or
formatted messages that were logged. (Contributed by Antoine Pitrou in
bpo-18937.)
Test discovery now works with namespace packages (Contributed by Claudiu Popa in bpo-17457.)
unittest.mock
objects now inspect their specification signatures when
matching calls, which means an argument can now be matched by either position
or name, instead of only by position. (Contributed by Antoine Pitrou in
bpo-17015.)
mock_open()
objects now have readline
and readlines
methods. (Contributed by Toshio Kuratomi in bpo-17467.)
venv¶
venv
now includes activation scripts for the csh
and fish
shells. (Contributed by Andrew Svetlov in bpo-15417.)
EnvBuilder
and the create()
convenience function
take a new keyword argument with_pip, which defaults to False
, that
controls whether or not EnvBuilder
ensures that pip
is
installed in the virtual environment. (Contributed by Nick Coghlan in
bpo-19552 as part of the PEP 453 implementation.)
wave¶
The getparams()
method now returns a namedtuple rather than a
plain tuple. (Contributed by Claudiu Popa in bpo-17487.)
wave.open()
now supports the context management protocol. (Contributed
by Claudiu Popa in bpo-17616.)
wave
can now write output to unseekable files. (Contributed by David Jones, Guilherme Polo, and Serhiy
Storchaka in bpo-5202.)
The writeframesraw()
and
writeframes()
methods now accept any bytes-like
object. (Contributed by Serhiy Storchaka in bpo-8311.)
weakref¶
New WeakMethod
class simulates weak references to bound
methods. (Contributed by Antoine Pitrou in bpo-14631.)
New finalize
class makes it possible to register a callback
to be invoked when an object is garbage collected, without needing to
carefully manage the lifecycle of the weak reference itself. (Contributed by
Richard Oudkerk in bpo-15528.)
The callback, if any, associated with a ref
is now
exposed via the __callback__
attribute. (Contributed
by Mark Dickinson in bpo-17643.)
xml.etree¶
A new parser, XMLPullParser
, allows a
non-blocking applications to parse XML documents. An example can be
seen at 用于非阻塞解析的拉取 API. (Contributed by Antoine
Pitrou in bpo-17741.)
The xml.etree.ElementTree
tostring()
and
tostringlist()
functions, and the
ElementTree
write()
method, now have a
short_empty_elements keyword-only parameter
providing control over whether elements with no content are written in
abbreviated (<tag />
) or expanded (<tag></tag>
) form. (Contributed by
Ariel Poliak and Serhiy Storchaka in bpo-14377.)
zipfile¶
The writepy()
method of the
PyZipFile
class has a new filterfunc option that can be
used to control which directories and files are added to the archive. For
example, this could be used to exclude test files from the archive.
(Contributed by Christian Tismer in bpo-19274.)
The allowZip64 parameter to ZipFile
and
PyZipfile
is now True
by default. (Contributed by
William Mallard in bpo-17201.)
CPython 实现的变化¶
PEP 445: 自定义 CPython 内存分配器¶
PEP 445 添加了新的 C 层级接口用来在 CPython 解释器中对内存分配进行自定义。
也參考
- PEP 445 -- 新增用于自定义 Python 内存分配器的 API
由 Victor Stinner 撰寫 PEP 與實作。
PEP 442: 安全的对象最终化¶
PEP 442 removes the current limitations and quirks of object finalization
in CPython. With it, objects with __del__()
methods, as well as
generators with finally
clauses, can be finalized when they are
part of a reference cycle.
As part of this change, module globals are no longer forcibly set to
None
during interpreter shutdown in most cases, instead relying
on the normal operation of the cyclic garbage collector. This avoids a
whole class of interpreter-shutdown-time errors, usually involving
__del__
methods, that have plagued Python since the cyclic GC
was first introduced.
也參考
- PEP 442 -- Safe object finalization
由 Antoine Pitrou 撰寫 PEP 與實作。
PEP 456: Secure and Interchangeable Hash Algorithm¶
PEP 456 follows up on earlier security fix work done on Python's hash algorithm to address certain DOS attacks to which public facing APIs backed by dictionary lookups may be subject. (See bpo-14621 for the start of the current round of improvements.) The PEP unifies CPython's hash code to make it easier for a packager to substitute a different hash algorithm, and switches Python's default implementation to a SipHash implementation on platforms that have a 64 bit data type. Any performance differences in comparison with the older FNV algorithm are trivial.
The PEP adds additional fields to the sys.hash_info
named tuple to
describe the hash algorithm in use by the currently executing binary. Otherwise,
the PEP does not alter any existing CPython APIs.
PEP 436: Argument Clinic¶
"Argument Clinic" (PEP 436) is now part of the CPython build process and can be used to simplify the process of defining and maintaining accurate signatures for builtins and standard library extension modules implemented in C.
Some standard library extension modules have been converted to use Argument
Clinic in Python 3.4, and pydoc
and inspect
have been updated
accordingly.
It is expected that signature metadata for programmatic introspection will be added to additional callables implemented in C as part of Python 3.4 maintenance releases.
備註
The Argument Clinic PEP is not fully up to date with the state of the implementation. This has been deemed acceptable by the release manager and core development team in this case, as Argument Clinic will not be made available as a public API for third party use in Python 3.4.
也參考
- PEP 436 -- The Argument Clinic DSL
由 Larry Hastings 撰寫 PEP 與實作。
Other Build and C API Changes¶
The new
PyType_GetSlot()
function has been added to the stable ABI, allowing retrieval of function pointers from named type slots when using the limited API. (Contributed by Martin von Löwis in bpo-17162.)The new
Py_SetStandardStreamEncoding()
pre-initialization API allows applications embedding the CPython interpreter to reliably force a particular encoding and error handler for the standard streams. (Contributed by Bastien Montagne and Nick Coghlan in bpo-16129.)Most Python C APIs that don't mutate string arguments are now correctly marked as accepting
const char *
rather thanchar *
. (Contributed by Serhiy Storchaka in bpo-1772673.)A new shell version of
python-config
can be used even when a python interpreter is not available (for example, in cross compilation scenarios).PyUnicode_FromFormat()
now supports width and precision specifications for%s
,%A
,%U
,%V
,%S
, and%R
. (Contributed by Ysj Ray and Victor Stinner in bpo-7330.)New function
PyStructSequence_InitType2()
supplements the existingPyStructSequence_InitType()
function. The difference is that it returns0
on success and-1
on failure.The CPython source can now be compiled using the address sanity checking features of recent versions of GCC and clang: the false alarms in the small object allocator have been silenced. (Contributed by Dhiru Kholia in bpo-18596.)
The Windows build now uses Address Space Layout Randomization and Data Execution Prevention. (Contributed by Christian Heimes in bpo-16632.)
New function
PyObject_LengthHint()
is the C API equivalent ofoperator.length_hint()
. (Contributed by Armin Ronacher in bpo-16148.)
其他改进¶
The python command has a new option,
-I
, which causes it to run in "isolated mode", which means thatsys.path
contains neither the script's directory nor the user'ssite-packages
directory, and allPYTHON*
environment variables are ignored (it implies both-s
and-E
). Other restrictions may also be applied in the future, with the goal being to isolate the execution of a script from the user's environment. This is appropriate, for example, when Python is used to run a system script. On most POSIX systems it can and should be used in the#!
line of system scripts. (Contributed by Christian Heimes in bpo-16499.)Tab-completion is now enabled by default in the interactive interpreter on systems that support
readline
. History is also enabled by default, and is written to (and read from) the file~/.python-history
. (Contributed by Antoine Pitrou and Éric Araujo in bpo-5845.)Invoking the Python interpreter with
--version
now outputs the version to standard output instead of standard error (bpo-18338). Similar changes were made toargparse
(bpo-18920) and other modules that have script-like invocation capabilities (bpo-18922).The CPython Windows installer now adds
.py
to thePATHEXT
variable when extensions are registered, allowing users to run a python script at the windows command prompt by just typing its name without the.py
extension. (Contributed by Paul Moore in bpo-18569.)A new
make
target coverage-report will build python, run the test suite, and generate an HTML coverage report for the C codebase usinggcov
and lcov.The
-R
option to the python regression test suite now also checks for memory allocation leaks, usingsys.getallocatedblocks()
. (Contributed by Antoine Pitrou in bpo-13390.)python -m
now works with namespace packages.The
stat
module is now implemented in C, which means it gets the values for its constants from the C header files, instead of having the values hard-coded in the python module as was previously the case.Loading multiple python modules from a single OS module (
.so
,.dll
) now works correctly (previously it silently returned the first python module in the file). (Contributed by Václav Šmilauer in bpo-16421.)A new opcode,
LOAD_CLASSDEREF
, has been added to fix a bug in the loading of free variables in class bodies that could be triggered by certain uses of __prepare__. (Contributed by Benjamin Peterson in bpo-17853.)A number of MemoryError-related crashes were identified and fixed by Victor Stinner using his PEP 445-based
pyfailmalloc
tool (bpo-18408, bpo-18520).The
pyvenv
command now accepts a--copies
option to use copies rather than symlinks even on systems where symlinks are the default. (Contributed by Vinay Sajip in bpo-18807.)pyvenv
命令也接受一个--without-pip
选项用来抑制在其他情况下将自动将 pip 初始设置到虚拟环境中。 (作为 PEP 453 实现的一部分由 Nick Coghlan 在 bpo-19552 中贡献。)现在编码格式名称在
PYTHONIOENCODING
环境变量的设置值中将为可选项。 这使得只设置错误处理句柄而不改变默认编码格式成为可能。 (由 Serhiy Storchaka 在 bpo-18818 中贡献。)现在
bz2
,lzma
, andgzip
模块的open
函数已支持x
(独占式创建) 模式。 (由 Tim Heaney 和 Vajrasky Kok 在 bpo-19201, bpo-19222 和 bpo-19223 中贡献。)
显著的优化¶
现在 UTF-32 解码器获得了 3x 至 4x 的提速。 (由 Serhiy Storchaka 在 bpo-14625 中贡献。)
The cost of hash collisions for sets is now reduced. Each hash table probe now checks a series of consecutive, adjacent key/hash pairs before continuing to make random probes through the hash table. This exploits cache locality to make collision resolution less expensive. The collision resolution scheme can be described as a hybrid of linear probing and open addressing. The number of additional linear probes defaults to nine. This can be changed at compile-time by defining LINEAR_PROBES to be any value. Set LINEAR_PROBES=0 to turn-off linear probing entirely. (Contributed by Raymond Hettinger in bpo-18771.)
The interpreter starts about 30% faster. A couple of measures lead to the speedup. The interpreter loads fewer modules on startup, e.g. the
re
,collections
andlocale
modules and their dependencies are no longer imported by default. The marshal module has been improved to load compiled Python code faster. (Contributed by Antoine Pitrou, Christian Heimes and Victor Stinner in bpo-19219, bpo-19218, bpo-19209, bpo-19205 and bpo-9548.)bz2.BZ2File
is now as fast or faster than the Python2 version for most cases.lzma.LZMAFile
has also been optimized. (Contributed by Serhiy Storchaka and Nadeem Vawda in bpo-16034.)random.getrandbits()
is 20%-40% faster for small integers (the most common use case). (Contributed by Serhiy Storchaka in bpo-16674.)By taking advantage of the new storage format for strings, pickling of strings is now significantly faster. (Contributed by Victor Stinner and Antoine Pitrou in bpo-15596.)
A performance issue in
io.FileIO.readall()
has been solved. This particularly affects Windows, and significantly speeds up the case of piping significant amounts of data throughsubprocess
. (Contributed by Richard Oudkerk in bpo-15758.)html.escape()
is now 10x faster. (Contributed by Matt Bryant in bpo-18020.)On Windows, the native
VirtualAlloc
is now used instead of the CRTmalloc
inobmalloc
. Artificial benchmarks show about a 3% memory savings.os.urandom()
now uses a lazily opened persistent file descriptor so as to avoid using many file descriptors when run in parallel from multiple threads. (Contributed by Antoine Pitrou in bpo-18756.)
弃用¶
This section covers various APIs and other features that have been deprecated
in Python 3.4, and will be removed in Python 3.5 or later. In most (but not
all) cases, using the deprecated APIs will produce a DeprecationWarning
when the interpreter is run with deprecation warnings enabled (for example, by
using -Wd
).
Python API 中的弃用¶
As mentioned in PEP 451: 针对导入系统的 ModuleSpec 类型, a number of
importlib
methods and functions are deprecated:importlib.find_loader()
is replaced byimportlib.util.find_spec()
;importlib.machinery.PathFinder.find_module()
is replaced byimportlib.machinery.PathFinder.find_spec()
;importlib.abc.MetaPathFinder.find_module()
is replaced byimportlib.abc.MetaPathFinder.find_spec()
;importlib.abc.PathEntryFinder.find_loader()
andfind_module()
are replaced byimportlib.abc.PathEntryFinder.find_spec()
; all of thexxxLoader
ABCload_module
methods (importlib.abc.Loader.load_module()
,importlib.abc.InspectLoader.load_module()
,importlib.abc.FileLoader.load_module()
,importlib.abc.SourceLoader.load_module()
) should no longer be implemented, instead loaders should implement anexec_module
method (importlib.abc.Loader.exec_module()
,importlib.abc.InspectLoader.exec_module()
importlib.abc.SourceLoader.exec_module()
) and let the import system take care of the rest; andimportlib.abc.Loader.module_repr()
,importlib.util.module_for_loader()
,importlib.util.set_loader()
, andimportlib.util.set_package()
are no longer needed because their functions are now handled automatically by the import system.The
imp
module is pending deprecation. To keep compatibility with Python 2/3 code bases, the module's removal is currently not scheduled.formatter
模块已被弃用并计划在 Python 3.6 中移除。将
MD5
作为hmac.new()
函数的默认 digestmod 的设置已被弃用。 Python 3.6 将要求以一个显式的摘要名称或构造器作为 digestmod 参数。很长一段时间以来
ftplib
模块中的内部Netrc
类在其文档字符串中被声明为已弃用。 现在它将发出DeprecationWarning
并将在 Python 3.5 中完全移除。传给
subprocess.Popen.wait()
的未写入文档的 endtime 参数不应被公开也不应被使用;它已被弃用并很可能在 Python 3.5 中移除。The strict argument of
HTMLParser
is deprecated.The
plistlib
readPlist()
,writePlist()
,readPlistFromBytes()
, andwritePlistToBytes()
functions are deprecated in favor of the corresponding new functionsload()
,dump()
,loads()
, anddumps()
.Data()
is deprecated in favor of just using thebytes
constructor.The
sysconfig
keySO
is deprecated, it has been replaced byEXT_SUFFIX
.The
U
mode accepted by variousopen
functions is deprecated. In Python3 it does not do anything useful, and should be replaced by appropriate uses ofio.TextIOWrapper
(if needed) and its newline argument.The parser argument of
xml.etree.ElementTree.iterparse()
has been deprecated, as has the html argument ofXMLParser()
. To prepare for the removal of the latter, all arguments toXMLParser
should be passed by keyword.
弃用的特性¶
移除¶
不再支持的操作系统¶
从源代码和构建工具中删除了对以下操作系统的支持:
API 与特性的移除¶
以下过时并在之前版本中弃用的 API 和特性现已被移除:
The unmaintained
Misc/TextMate
andMisc/vim
directories have been removed (see the devguide for suggestions on what to use instead).The
SO
makefile macro is removed (it was replaced by theSHLIB_SUFFIX
andEXT_SUFFIX
macros) (bpo-16754).The
PyThreadState.tick_counter
field has been removed; its value has been meaningless since Python 3.2, when the "new GIL" was introduced (bpo-19199).PyLoader
andPyPycLoader
have been removed fromimportlib
. (Contributed by Taras Lyapun in bpo-15641.)The strict argument to
HTTPConnection
andHTTPSConnection
has been removed. HTTP 0.9-style "Simple Responses" are no longer supported.The deprecated
urllib.request.Request
getter and setter methodsadd_data
,has_data
,get_data
,get_type
,get_host
,get_selector
,set_proxy
,get_origin_req_host
, andis_unverifiable
have been removed (use direct attribute access instead).Support for loading the deprecated
TYPE_INT64
has been removed frommarshal
. (Contributed by Dan Riti in bpo-15480.)inspect.Signature
: positional-only parameters are now required to have a valid name.object.__format__()
no longer accepts non-empty format strings, it now raises aTypeError
instead. Using a non-empty string has been deprecated since Python 3.2. This change has been made to prevent a situation where previously working (but incorrect) code would start failing if an object gained a __format__ method, which means that your code may now raise aTypeError
if you are using an's'
format code with objects that do not have a __format__ method that handles it. See bpo-7994 for background.difflib.SequenceMatcher.isbjunk()
和difflib.SequenceMatcher.isbpopular()
已在 3.2 中被弃用,现在已被移除:请使用x in sm.bjunk
和x in sm.bpopular
,其中 sm 是一个SequenceMatcher
对象 (bpo-13248)。
代码清理¶
移植到 Python 3.4¶
本节列出了先前描述的更改以及可能需要更改代码的其他错误修正.
'python' 命令行为的变化¶
In a posix shell, setting the
PATH
environment variable to an empty value is equivalent to not setting it at all. However, settingPYTHONPATH
to an empty value was not equivalent to not setting it at all: settingPYTHONPATH
to an empty value was equivalent to setting it to.
, which leads to confusion when reasoning by analogy to howPATH
works. The behavior now conforms to the posix convention forPATH
.The [X refs, Y blocks] output of a debug (
--with-pydebug
) build of the CPython interpreter is now off by default. It can be re-enabled using the-X showrefcount
option. (Contributed by Ezio Melotti in bpo-17323.)The python command and most stdlib scripts (as well as
argparse
) now output--version
information tostdout
instead ofstderr
(for issue list see 其他改进 above).
Python API 的变化¶
The ABCs defined in
importlib.abc
now either raise the appropriate exception or return a default value instead of raisingNotImplementedError
blindly. This will only affect code callingsuper()
and falling through all the way to the ABCs. For compatibility, catch bothNotImplementedError
or the appropriate exception as needed.The module type now initializes the
__package__
and__loader__
attributes toNone
by default. To determine if these attributes were set in a backwards-compatible fashion, use e.g.getattr(module, '__loader__', None) is not None
. (bpo-17115.)importlib.util.module_for_loader()
now sets__loader__
and__package__
unconditionally to properly support reloading. If this is not desired then you will need to set these attributes manually. You can useimportlib.util.module_to_load()
for module management.Import now resets relevant attributes (e.g.
__name__
,__loader__
,__package__
,__file__
,__cached__
) unconditionally when reloading. Note that this restores a pre-3.3 behavior in that it means a module is re-found when re-loaded (bpo-19413).Frozen packages no longer set
__path__
to a list containing the package name, they now set it to an empty list. The previous behavior could cause the import system to do the wrong thing on submodule imports if there was also a directory with the same name as the frozen package. The correct way to determine if a module is a package or not is to usehasattr(module, '__path__')
(bpo-18065).Frozen modules no longer define a
__file__
attribute. It's semantically incorrect for frozen modules to set the attribute as they are not loaded from any explicit location. If you must know that a module comes from frozen code then you can see if the module's__spec__.location
is set to'frozen'
, check if the loader is a subclass ofimportlib.machinery.FrozenImporter
, or if Python 2 compatibility is necessary you can useimp.is_frozen()
.py_compile.compile()
now raisesFileExistsError
if the file path it would write to is a symlink or a non-regular file. This is to act as a warning that import will overwrite those files with a regular file regardless of what type of file path they were originally.importlib.abc.SourceLoader.get_source()
no longer raisesImportError
when the source code being loaded triggers aSyntaxError
orUnicodeDecodeError
. AsImportError
is meant to be raised only when source code cannot be found but it should, it was felt to be over-reaching/overloading of that meaning when the source code is found but improperly structured. If you were catching ImportError before and wish to continue to ignore syntax or decoding issues, catch all three exceptions now.functools.update_wrapper()
andfunctools.wraps()
now correctly set the__wrapped__
attribute to the function being wrapped, even if that function also had its__wrapped__
attribute set. This means__wrapped__
attributes now correctly link a stack of decorated functions rather than every__wrapped__
attribute in the chain referring to the innermost function. Introspection libraries that assumed the previous behaviour was intentional can useinspect.unwrap()
to access the first function in the chain that has no__wrapped__
attribute.inspect.getfullargspec()
has been reimplemented on top ofinspect.signature()
and hence handles a much wider variety of callable objects than it did in the past. It is expected that additional builtin and extension module callables will gain signature metadata over the course of the Python 3.4 series. Code that assumes thatinspect.getfullargspec()
will fail on non-Python callables may need to be adjusted accordingly.importlib.machinery.PathFinder
now passes on the current working directory to objects insys.path_hooks
for the empty string. This results insys.path_importer_cache
never containing''
, thus iterating throughsys.path_importer_cache
based onsys.path
will not find all keys. A module's__file__
when imported in the current working directory will also now have an absolute path, including when using-m
with the interpreter (except for__main__.__file__
when a script has been executed directly using a relative path) (Contributed by Brett Cannon in bpo-18416). is specified on the command-line) (bpo-18416).The removal of the strict argument to
HTTPConnection
andHTTPSConnection
changes the meaning of the remaining arguments if you are specifying them positionally rather than by keyword. If you've been paying attention to deprecation warnings your code should already be specifying any additional arguments via keywords.Strings between
from __future__ import ...
statements now always raise aSyntaxError
. Previously if there was no leading docstring, an interstitial string would sometimes be ignored. This brings CPython into compliance with the language spec; Jython and PyPy already were. (bpo-17434).ssl.SSLSocket.getpeercert()
andssl.SSLSocket.do_handshake()
now raise anOSError
withENOTCONN
when theSSLSocket
is not connected, instead of the previous behavior of raising anAttributeError
. In addition,getpeercert()
will raise aValueError
if the handshake has not yet been done.base64.b32decode()
now raises abinascii.Error
when the input string contains non-b32-alphabet characters, instead of aTypeError
. This particularTypeError
was missed when the otherTypeError
s were converted. (Contributed by Serhiy Storchaka in bpo-18011.) Note: this change was also inadvertently applied in Python 3.3.3.The
file
attribute is now automatically closed when the creatingcgi.FieldStorage
instance is garbage collected. If you were pulling the file object out separately from thecgi.FieldStorage
instance and not keeping the instance alive, then you should either store the entirecgi.FieldStorage
instance or read the contents of the file before thecgi.FieldStorage
instance is garbage collected.Calling
read
orwrite
on a closed SSL socket now raises an informativeValueError
rather than the previous more mysteriousAttributeError
(bpo-9177).slice.indices()
no longer produces anOverflowError
for huge values. As a consequence of this fix,slice.indices()
now raises aValueError
if given a negative length; previously it returned nonsense values (bpo-14794).The
complex
constructor, unlike thecmath
functions, was incorrectly acceptingfloat
values if an object's__complex__
special method returned one. This now raises aTypeError
. (bpo-16290.)The
int
constructor in 3.2 and 3.3 erroneously acceptsfloat
values for the base parameter. It is unlikely anyone was doing this, but if so, it will now raise aTypeError
(bpo-16772).Defaults for keyword-only arguments are now evaluated after defaults for regular keyword arguments, instead of before. Hopefully no one wrote any code that depends on the previous buggy behavior (bpo-16967).
Stale thread states are now cleared after
fork()
. This may cause some system resources to be released that previously were incorrectly kept perpetually alive (for example, database connections kept in thread-local storage). (bpo-17094.)Parameter names in
__annotations__
dicts are now mangled properly, similarly to__kwdefaults__
. (Contributed by Yury Selivanov in bpo-20625.)hashlib.hash.name
now always returns the identifier in lower case. Previously some builtin hashes had uppercase names, but now that it is a formal public interface the naming has been made consistent (bpo-18532).Because
unittest.TestSuite
now drops references to tests after they are run, test harnesses that re-use aTestSuite
to re-run a set of tests may fail. Test suites should not be re-used in this fashion since it means state is retained between test runs, breaking the test isolation thatunittest
is designed to provide. However, if the lack of isolation is considered acceptable, the old behavior can be restored by creating aTestSuite
subclass that defines a_removeTestAtIndex
method that does nothing (seeTestSuite.__iter__()
) (bpo-11798).unittest
now usesargparse
for command line parsing. There are certain invalid command forms that used to work that are no longer allowed; in theory this should not cause backward compatibility issues since the disallowed command forms didn't make any sense and are unlikely to be in use.The
re.split()
,re.findall()
, andre.sub()
functions, and thegroup()
andgroups()
methods ofmatch
objects now always return a bytes object when the string to be matched is a bytes-like object. Previously the return type matched the input type, so if your code was depending on the return value being, say, abytearray
, you will need to change your code.audioop
functions now raise an error immediately if passed string input, instead of failing randomly later on (bpo-16685).The new convert_charrefs argument to
HTMLParser
currently defaults toFalse
for backward compatibility, but will eventually be changed to default toTrue
. It is recommended that you add this keyword, with the appropriate value, to anyHTMLParser
calls in your code (bpo-13633).Since the digestmod argument to the
hmac.new()
function will in the future have no default, all calls tohmac.new()
should be changed to explicitly specify a digestmod (bpo-17276).Calling
sysconfig.get_config_var()
with theSO
key, or lookingSO
up in the results of a call tosysconfig.get_config_vars()
is deprecated. This key should be replaced byEXT_SUFFIX
orSHLIB_SUFFIX
, depending on the context (bpo-19555).Any calls to
open
functions that specifyU
should be modified.U
is ineffective in Python3 and will eventually raise an error if used. Depending on the function, the equivalent of its old Python2 behavior can be achieved using either a newline argument, or if necessary by wrapping the stream inTextIOWrapper
to use its newline argument (bpo-15204).If you use
pyvenv
in a script and desire that pip not be installed, you must add--without-pip
to your command invocation.The default behavior of
json.dump()
andjson.dumps()
when an indent is specified has changed: it no longer produces trailing spaces after the item separating commas at the ends of lines. This will matter only if you have tests that are doing white-space-sensitive comparisons of such output (bpo-16333).doctest
now looks for doctests in extension module__doc__
strings, so if your doctest test discovery includes extension modules that have things that look like doctests in them you may see test failures you've never seen before when running your tests (bpo-3158).The
collections.abc
module has been slightly refactored as part of the Python startup improvements. As a consequence of this, it is no longer the case that importingcollections
automatically importscollections.abc
. If your program depended on the (undocumented) implicit import, you will need to add an explicitimport collections.abc
(bpo-20784).
C API 中的改動¶
PyEval_EvalFrameEx()
,PyObject_Repr()
, andPyObject_Str()
, along with some other internal C APIs, now include a debugging assertion that ensures they are not used in situations where they may silently discard a currently active exception. In cases where discarding the active exception is expected and desired (for example, because it has already been saved locally withPyErr_Fetch()
or is being deliberately replaced with a different exception), an explicitPyErr_Clear()
call will be needed to avoid triggering the assertion when invoking these operations (directly or indirectly) and running against a version of Python that is compiled with assertions enabled.PyErr_SetImportError()
now setsTypeError
when its msg argument is not set. Previously onlyNULL
was returned with no exception set.The result of the
PyOS_ReadlineFunctionPointer
callback must now be a string allocated byPyMem_RawMalloc()
orPyMem_RawRealloc()
, orNULL
if an error occurred, instead of a string allocated byPyMem_Malloc()
orPyMem_Realloc()
(bpo-16742)现在
PyThread_set_key_value()
总是会设置值。 在 Python 3.3 中,如果键已存在(如果当前值为非NULL
指针)该函数将不执行任何操作。PyFrameObject
结构体的f_tstate
(线程状态) 字段已被移除以修复一个程序错误;相关理由参见 bpo-14432。
3.4.3 的变化¶
PEP 476: 默认为 stdlib http 客户端启用证书验证¶
http.client
及其他依赖它的模块,比如 urllib.request
和 xmlrpc.client
,现在将验证服务器是否提供了由平台信任的仓库中的 CA 签名的证书并且其主机名与默认被请求的主机名相匹配,这将显著提升许多应用程序的安全性。
对于需要之前版本的旧有行为的应用程序,可以传入一个替代的上下文:
import urllib.request
import ssl
# This disables all verification
context = ssl._create_unverified_context()
# This allows using a specific certificate for the host, which doesn't need
# to be in the trust store
context = ssl.create_default_context(cafile="/path/to/file.crt")
urllib.request.urlopen("https://invalid-cert", context=context)