Skip to main content

Questions tagged [protobuf]

Protocol Buffers are a serialization format with an interface description language developed by Google. Source:

Filter by
Sorted by
Tagged with
1 vote
1 answer

Recommended generic approach to checking scalar field presence in protobuf 3

There are several questions related to presence field tracking of scalar fields in protobuf 3, but I didn't find any with generic default approach recommendation. It may be useful to be able to track ...
Alex Che's user avatar
  • 133
0 votes
0 answers

Permissive vs Strict API

This question is similar to Permissive vs. Strict API Message validation. One difference is that we're using Protobuf. A colleague and I are discussing standard message types for names. One ...
Noel Yap's user avatar
  • 171
1 vote
0 answers

Is non-contiguous protobuf field numbering an anti-pattern?

Is it an anti-pattern to have gaps in field numbers to aid readability? The need being address by this idea is that metadata fields, which are "aspect" fields, can be placed in the proto ...
Bohemian's user avatar
  • 2,006
1 vote
1 answer

Using protobuf to store large array of doubles

For my job, I'm working on a project that involves working with robot sensor data. We've been using protobuf to serialize and transfer data. I'm trying to set up a new protobuf type but this data ...
user81147's user avatar
  • 119
0 votes
0 answers

Why does Protobuf generate outer classes for Java?

I googled this and found questions like "How to use Protobuf message as java class without a java outer class?" (
Matt Welke's user avatar
-2 votes
2 answers

Prefer passing class or variable as const reference

In my company's code base there are examples of methods which receive some protobuf messages and use them in this fashion: void doSomething(const A& a) { // Only data from is used in ...
Iacopo Olivo's user avatar
1 vote
0 answers

Separating generated flatbuffer/protobuf files from domain model - best practices

I'm using flatbuffers for the first time. I've generated my java classes and have tested out serializing / deserializaing a message. Now I'm thinking about how to integrate these in to my JavaFx and ...
Stealth Rabbi's user avatar
0 votes
0 answers

Is it idiomatic to use protobufs as containers within a service?

I love gRPC, but I find every step of the protobuf process rather frustrating (particularly in Python). Even though they are structurally similar to data structures composed of lists and dicts, you ...
DeusXMachina's user avatar
1 vote
0 answers

What's the most intuitive way to organize a set of endpoints to fetch users and their roles in groups?

What's the most intuitive way to organize a set of endpoints to fetch users and their roles in groups? i.e. Users and their roles in a specified group. Groups a user is in, and their role in each ...
Andrew Cheong's user avatar
1 vote
2 answers

What are the "scalar fields" and "composite fields" in JAVA?

Need to understand the below definition, from the protobuf tutorial: mergeFrom(Message other): (builder only) merges the contents of other into this message, overwriting singular scalar fields, ...
RafiAlhamd's user avatar
1 vote
1 answer

How to handle adding new field / partial data update for a gRPC API?

Assuming we have following message that will be used to update data and it just got updated to version 2. message HelloRequest { string name = 1; // version 1 bool is_valid = 2; // version 2 } ...
Jan Paolo Go's user avatar
1 vote
1 answer

Why protobuf is said to be in binary format although we write it in text format similar to json

JSON { "hello": "world" } Protobuf message HelloWorld { required string name = 1; } Why do we say that protobuf uses binary format during network exchange and json don't, even though network ...
pzk's user avatar
  • 29
2 votes
2 answers

Options for having model, parsers and serializers for a given data-format generated in multiple languages?

I am member of the Apache PLC4X (incubating) project. Here we are currently implementing multiple industry PLC protocols. While we initially focussed on creating Java versions of these, we are ...
Christofer Dutz's user avatar
2 votes
1 answer

Protobuf: compile specification once, use generated code everywhere?

Once written, a protobuf specification can be compiled using protoc to a variety of implementations in different languages (e.g. python, c++, go). That's great. But to compile that generated code, you ...
AkiRoss's user avatar
  • 129
1 vote
0 answers

Can I add new function for protobuf generated struct

I am using protobuf definitions to define message types. Structure looks like message1 { } message2 { bytes msg1 = 1 } So message2 has a field which is a byte array representation of message1. I ...
Korba's user avatar
  • 111
0 votes
2 answers

Consuming external APIs within the microservice architecture

I'm writing a small microservice-based application. One of the services is assigned the task of querying an external API and processing the JSON response (filtered list of houses). Since I'm using ...
Rtsne42's user avatar
  • 125
3 votes
2 answers

Reverse engineering an ETL pipeline

I have a one-way large ETL pipeline in Scala where I start with protobuf schema A and end up with protobuf schema B. I want to create a many-to-many mapping between the fields of schema A and schema B,...
Conor's user avatar
  • 109
30 votes
1 answer

Why Protobuf 3 made all fields on the messages optional?

The syntax 3 of protobuf made all the fields optional dropping the keywords required and optional from previous proto2 syntax. Reading some comments from developers it seems that it was done for ...
tonicebrian's user avatar
1 vote
2 answers

Arbitrary protobuf message as byte-array over Websocket - how to determine actual message type upfront

Protobuf is nice and dandy, but it was not made with self-description in mind. Now this is totally okay if you're using a well-defined protocol and want to replace e.g. SOAP-messages or just want to ...
Sorona's user avatar
  • 139
5 votes
1 answer

Is it rational to convert protobuf into json to send it to a web server?

Protobuf is a good thing, it allows c++ devs to not bother with class serialization/deserialization, is fast and .proto format is very nice. It also allows automatic data validation. But the messages ...
Zeks's user avatar
  • 221
0 votes
0 answers

Is it possible to use Protocol Buffers natively for message passing between a Go web service and an Android app?

I want to connect an Android app to a Go web service (I have a small social network in mind) and would like to pass data to and from the web service using Protocol Buffers, since it recently seems to ...
warsong's user avatar
  • 119
0 votes
1 answer

JSON or protocol buffer to replace the custom TCP message

Originally, We have two applications communication with TCP/IP, and both of them are implemented by C++. The messages between them are custom message type. Now the client program will be changed to ...
zangw's user avatar
  • 141
24 votes
2 answers

Protobuf design patterns

I am evaluating Google Protocol Buffers for a Java based service (but am expecting language agnostic patterns). I have two questions: The first is a broad general question: What patterns are we ...
Apoorv's user avatar
  • 1,128