我是 protobufs 的新手，目前正在編寫一個從 nats 伺服器讀取資料的客戶端。從 nats 伺服器發送的資料是 protobuf。
我正在寫的客戶端是用 go 寫的。這是我寫的 .proto 檔案：
syntax = "proto3";
package execution;
option go_package = "./protos/execution";
enum orderstatus {
working = 0;
rejected = 1;
cancelled = 2;
completed = 3;
}
enum ordertype {
limit = 0;
market = 1;
stoplimit = 2;
stopmarket = 3;
}
enum orderside {
buy = 0;
sell = 1;
}
enum rejectreason {
norejection = 0;
instrumentnotfound = 1;
ordernotfound = 2;
invalidordertype = 3;
invalidaccount = 4;
invalidside = 5;
invalidamount = 6;
invalidlimitprice = 7;
invalidquotelimit = 8;
invalidactivationprice = 9;
invalidtimeinforce = 10;
markethalted = 11;
marketpaused = 12;
nocounterorders = 13;
missingexpirationtime = 14;
incorrectexpirationtime = 15;
internalerror = 16;
illegalstatusswitch = 17;
orderalreadyexists = 18;
instrumentnotready = 19;
externalsystemerror = 20;
}
enum reportcause {
none = 0;
neworder = 1;
cancelorder = 2;
masscancel = 3;
expiration = 4;
trigger = 5;
marketstatuschange = 6;
}
enum timeinforce {
goodtillcancel = 0;
immediateorcancel = 1;
fillorkill = 2;
}
enum cancelreason {
notcancelled = 0;
cancelledbytrader = 1;
cancelledbysystem = 2;
selfmatchprevention = 3;
ordertimeinforce = 4;
liquidation = 100;
}
message tradedata {
int64 tradeid = 1;
string amount = 4;
string executionprice = 5;
orderstatus orderstatus = 7;
int64 accountid = 11;
string matchedorderexternalid = 14;
int64 matchedorderid = 16;
string remainingamount = 17;
}
message execution {
string origin = 4;
orderside side = 7;
string requestedprice = 8;
string requestedamount = 9;
string remainingamount = 10;
int64 executedat = 13;
orderstatus orderstatus = 14;
repeated tradedata trades = 16;
ordertype ordertype = 20;
int64 version = 22;
int64 accountid = 23;
rejectreason rejectreason = 25;
reportcause reportcause = 26;
string instructionid = 27;
string externalorderid = 28;
int32 executionenginemarketid = 29;
int64 orderid = 30;
cancelreason cancelreason = 31;
int64 txid = 32;
timeinforce timeinforce = 34;
string cancelledby = 35;
}發布伺服器是用 c# 寫的，其原始訊息的程式碼如下：
[protocontract]
public class executionreport : imarketresponse, iinstructionmessage, iordermatcherresponse
{
[protoignore]
feedmessagetype ifeedmessage.type => feedmessagetype.executionreport;
// resharper disable fieldcanbemadereadonly.global
[protomember(4)] public string origin;
[protomember(7)] public orderside side;
[protomember(8)] public decimal requestedprice;
[protomember(9)] public decimal requestedamount;
[protomember(10)] public decimal remainingamount;
[protomember(13)] public long executedat;
[protomember(14)] public orderstatus orderstatus;
[protomember(16)] public list<tradedata> trades = new list<tradedata>();
[protomember(20)] public ordertype ordertype;
[protomember(22)] public long version { get; set; }
[protomember(23)] public long accountid;
[protomember(25)] public rejectreason rejectreason;
[protomember(26)] public reportcause reportcause;
[protomember(27)] public guid instructionid { get; set; }
[protomember(28)] public guid externalorderid;
[protomember(29)] public int executionenginemarketid { get; set; }
[protomember(30)] public long orderid;
[protomember(31)] public cancelreason cancelreason;
[protomember(32)] public long txid;
[protomember(34)] public timeinforce timeinforce;
[protomember(35)] public string cancelledby;
}
[protocontract]
[structlayout(layoutkind.sequential)]
public struct tradedata
{
[protomember(1)] public long tradeid;
[protomember(4)] public decimal amount;
[protomember(5)] public decimal executionprice;
[protomember(7)] public orderstatus orderstatus;
[protomember(11)] public long accountid;
[protomember(14)] public guid matchedorderexternalid;
[protomember(16)] public long matchedorderid;
[protomember(17)] public decimal remainingamount;
}在嘗試解組資料時出現此錯誤
proto: cannot parse invalid wire-format data
這就是我解析資料的方式：
_, err = sc.subscribe("exec", func(m *stan.msg) {
varr := &protos.execution{}
err = proto.unmarshal(m.data, varr)
if err != nil {
fmt.printf("err unmarshalling!: %v\n\n", err.error())
} else {
fmt.printf("received a message: %+v\n", varr)
}我從伺服器接收到的範例位元組資料：
[5 85 0 0 0 56 1 66 3 8 144 78 74 2 8 1 82 2 8 1 104 197 192 132 194 159 143 219 237 8 176 1 25 184 1 11 208 1 1 218 1 18 9 133 66 138 247 239 67 93 77 17 176 192 189 75 170 203 186 145 226 1 18 9 133 66 138 247 239 67 93 77 17 176 192 189 75 170 203 186 145 232 1 1 240 1 25 128 2 25]
新增更多詳細資訊：
這就是 c# 發送資料的方式：
public async task sendasync(ifeedmessage msg)
{
var subject = feedsubject.formessage(msg);
var data = msg.serializetoarray();
using (_metrics.feedsendlatency.start(new metrictags("subject", subject.value)))
{
await _connection.publishasync(subject, data);
}
}這是feedmessage的結構（executionreport也間接繼承它）
public interface ifeedmessage
{
feedmessagetype type { get; }
ifeedmessage clone();
void reset();
}這就是 serializetoarray() 的工作原理：
public static ArraySegment<byte> SerializeToArray(this IFeedMessage message)
{
return message.SerializeToMemory(new MemoryStream());
}
public static ArraySegment<byte> SerializeToMemory(this IFeedMessage message, MemoryStream stream)
{
var start = stream.Position;
message.Serialize(stream);
return new ArraySegment<byte>(stream.GetBuffer(), (int)start, (int)(stream.Position - start));
}
public static void Serialize(this IFeedMessage message, Stream stream)
{
stream.WriteByte((byte)message.Type);
RuntimeTypeModel.Default.SerializeWithLengthPrefix(stream, message, message.GetType(), PrefixStyle.Fixed32, 0);
}不知道具體原因是什麼。但我寫的proto檔案似乎是錯的。我瀏覽了幾篇面臨相同錯誤的帖子，但大多數都沒有解決相同的問題。如果需要任何其他詳細信息，請告訴我。
請幫我解決這個問題。
根據評論中的討論，我成功地整理了數據。
註解：
decimal 和 guid 資料類型。 （如 bcl.proto 中所評論的，跨平台程式碼通常應該完全避免它們）。 這是資料夾結構：
├── bcl.proto
├── execution.proto
├── go.mod
├── go.sum
├── main.go
└── protos
├── bcl.pb.go
└── execution.pb.gobcl.proto：
此檔案是從 github 複製的。 com/protobuf-net/protobuf-net。這是必需的，因為 .net 實作使用此原始檔案中的 decimal 和 guid。
// the types in here indicate how protobuf-net represents certain types when using protobuf-net specific
// library features. note that it is not *required* to use any of these types, and cross-platform code
// should usually avoid them completely (ideally starting from a .proto schema)
// some of these are ugly, sorry. the timespan / datetime dates here pre-date the introduction of timestamp
// and duration, and the "well known" types should be preferred when possible. guids are particularly
// awkward - it turns out that there are multiple guid representations, and i accidentally used one that
// i can only call... "crazy-endian". just make sure you check the order!
// it should not be necessary to use bcl.proto from code that uses protobuf-net
syntax = "proto3";
option csharp_namespace = "protobuf.bcl";
option go_package = "./protos";
package bcl;
message timespan {
sint64 value = 1; // the size of the timespan (in units of the selected scale)
timespanscale scale = 2; // the scale of the timespan [default = days]
enum timespanscale {
days = 0;
hours = 1;
minutes = 2;
seconds = 3;
milliseconds = 4;
ticks = 5;
minmax = 15; // dubious
}
}
message datetime {
sint64 value = 1; // the offset (in units of the selected scale) from 1970/01/01
timespanscale scale = 2; // the scale of the timespan [default = days]
datetimekind kind = 3; // the kind of date/time being represented [default = unspecified]
enum timespanscale {
days = 0;
hours = 1;
minutes = 2;
seconds = 3;
milliseconds = 4;
ticks = 5;
minmax = 15; // dubious
}
enum datetimekind
{
// the time represented is not specified as either local time or coordinated universal time (utc).
unspecified = 0;
// the time represented is utc.
utc = 1;
// the time represented is local time.
local = 2;
}
}
message netobjectproxy {
int32 existingobjectkey = 1; // for a tracked object, the key of the **first** time this object was seen
int32 newobjectkey = 2; // for a tracked object, a **new** key, the first time this object is seen
int32 existingtypekey = 3; // for dynamic typing, the key of the **first** time this type was seen
int32 newtypekey = 4; // for dynamic typing, a **new** key, the first time this type is seen
string typename = 8; // for dynamic typing, the name of the type (only present along with newtypekey)
bytes payload = 10; // the new string/value (only present along with newobjectkey)
}
message guid {
fixed64 lo = 1; // the first 8 bytes of the guid (note:crazy-endian)
fixed64 hi = 2; // the second 8 bytes of the guid (note:crazy-endian)
}
message decimal {
uint64 lo = 1; // the first 64 bits of the underlying value
uint32 hi = 2; // the last 32 bis of the underlying value
uint32 signscale = 3; // the number of decimal digits (bits 1-16), and the sign (bit 0)
}execution.proto
syntax = "proto3";
package execution;
option go_package = "./protos";
import "bcl.proto";
enum orderstatus {
working = 0;
rejected = 1;
cancelled = 2;
completed = 3;
}
enum ordertype {
limit = 0;
market = 1;
stoplimit = 2;
stopmarket = 3;
}
enum orderside {
buy = 0;
sell = 1;
}
enum rejectreason {
norejection = 0;
instrumentnotfound = 1;
ordernotfound = 2;
invalidordertype = 3;
invalidaccount = 4;
invalidside = 5;
invalidamount = 6;
invalidlimitprice = 7;
invalidquotelimit = 8;
invalidactivationprice = 9;
invalidtimeinforce = 10;
markethalted = 11;
marketpaused = 12;
nocounterorders = 13;
missingexpirationtime = 14;
incorrectexpirationtime = 15;
internalerror = 16;
illegalstatusswitch = 17;
orderalreadyexists = 18;
instrumentnotready = 19;
externalsystemerror = 20;
}
enum reportcause {
none = 0;
neworder = 1;
cancelorder = 2;
masscancel = 3;
expiration = 4;
trigger = 5;
marketstatuschange = 6;
}
enum timeinforce {
goodtillcancel = 0;
immediateorcancel = 1;
fillorkill = 2;
}
enum cancelreason {
notcancelled = 0;
cancelledbytrader = 1;
cancelledbysystem = 2;
selfmatchprevention = 3;
ordertimeinforce = 4;
liquidation = 100;
}
message tradedata {
int64 tradeid = 1;
bcl.decimal amount = 4;
bcl.decimal executionprice = 5;
orderstatus orderstatus = 7;
int64 accountid = 11;
bcl.guid matchedorderexternalid = 14;
int64 matchedorderid = 16;
bcl.decimal remainingamount = 17;
}
message execution {
bytes origin = 4;
orderside side = 7;
bcl.decimal requestedprice = 8;
bcl.decimal requestedamount = 9;
bcl.decimal remainingamount = 10;
int64 executedat = 13;
orderstatus orderstatus = 14;
repeated tradedata trades = 16;
ordertype ordertype = 20;
int64 version = 22;
int64 accountid = 23;
rejectreason rejectreason = 25;
reportcause reportcause = 26;
bcl.guid instructionid = 27;
bcl.guid externalorderid = 28;
int32 executionenginemarketid = 29;
int64 orderid = 30;
cancelreason cancelreason = 31;
int64 txid = 32;
timeinforce timeinforce = 34;
string cancelledby = 35;
}原型/
此資料夾中的檔案是使用以下命令從 proto 檔案產生的：
protoc --go_out=protos --go_opt=paths=source_relative bcl.proto execution.proto
go.mod
#module mymodule.local go 1.20 require google.golang.org/protobuf v1.30.0
main.go
package main
import (
"encoding/binary"
"log"
"google.golang.org/protobuf/proto"
"mymodule.local/protos"
)
func main() {
data := []byte{5, 85, 0, 0, 0, 56, 1, 66, 3, 8, 144, 78, 74, 2, 8, 1, 82, 2, 8, 1, 104, 197, 192, 132, 194, 159, 143, 219, 237, 8, 176, 1, 25, 184, 1, 11, 208, 1, 1, 218, 1, 18, 9, 133, 66, 138, 247, 239, 67, 93, 77, 17, 176, 192, 189, 75, 170, 203, 186, 145, 226, 1, 18, 9, 133, 66, 138, 247, 239, 67, 93, 77, 17, 176, 192, 189, 75, 170, 203, 186, 145, 232, 1, 1, 240, 1, 25, 128, 2, 25}
if len(data) < 5 {
log.fatal("data should contain at least 5 bytes")
}
messagetype := data[0]
length := binary.littleendian.uint32(data[1:5])
data = data[5:]
if length != uint32(len(data)) {
log.fatalf("invalid data length: %d", length)
}
execution := &protos.execution{}
err := proto.unmarshal(data, execution)
if err != nil {
log.fatalf("err unmarshalling!: %v", err)
}
log.printf("message type: %d, message: %+v", messagetype, execution)
}
問題中提供的資料的輸出：
2023/06/15 17:50:58 message type: 5, message: Side:Sell RequestedPrice:{lo:10000} RequestedAmount:{lo:1} RemainingAmount:{lo:1} ExecutedAt:638223043314917445 Version:25 AccountId:11 ReportCause:NewOrder InstructionId:{lo:5574686611683820165 hi:10500929413443338416} ExternalOrderId:{lo:5574686611683820165 hi:10500929413443338416} ExecutionEngineMarketId:1 OrderId:25 TxId:25以上是proto：無法解析無效的有線格式數據的詳細內容。更多資訊請關注PHP中文網其他相關文章！
