Questions tagged [dataflow]
The dataflow tag has no summary.
25 questions
1
vote
2
answers
49
views
Do data stores in a Level 1 DFD have to match the tables in the ERD exactly?
We're developing an anomaly detection web app as a Capstone Project, and we're currently revising our manuscript.
In our last capstone defense, one of our panelists mentioned that the data stores in ...
-1
votes
1
answer
87
views
Flow of data in GUI apps
When syncing data between different levels in Swing (or any GUI project, for that matter), what is the right flow of data in that sync chain? Like so?
DB -> Model -> UI
I was trying to implement ...
- 2,030
17
votes
8
answers
5k
views
When should a function be given an argument vs getting the data itself?
When is it better to pass data to a function in a parameter, and when is it better for the function to just fetch the data itself?
Here's some simplified examples in PowerShell:
Option 1 (give the ...
- 181
0
votes
1
answer
628
views
Using both websocket and REST for the application requiring two-way communication
I am currently implementing front-end part of the collaborative application requiring two-way live communication between server and the web app. Cloud service responsible for the data exchange will be ...
1
vote
0
answers
146
views
Where should I persist the side effects of actions?
I have a outlining app that I am writing using unidirectional dataflow and some of the concepts from Redux.
When the user has selects items in the outline, and clicks indent, an indent action is fired....
- 89
2
votes
1
answer
257
views
How (whether to?) include Apache Spark in my Architecture
Brief overview of general data flow
The general goal of my system is to allow users to upload many different types of files containing data (PDF, CSV, ZIP, etc.), then index it and perform some basic ...
-1
votes
1
answer
366
views
Do other languages have variables shared between threads?
I guess it would be too complex for Node.js / JavaScript to leverage, but I've been working with clusters in node to break big tasks down so all cores can work at once but the inter-process messaging ...
- 3,833
0
votes
3
answers
685
views
Diagram to show how one object "becomes" another?
I am working in a purchasing system where we take calls:
public class Call
{
public List<CallItem> CallItems { get; set; }
}
The calls can be turned into quotes, where call items become ...
- 19
0
votes
0
answers
75
views
Program Simulation Techniques
I've noticed that data-flow analysis uses approximations of a programs steps by simulating the value flow in some way (which I don't fully understand yet). They describe it well here. On page 4 they ...
- 2,757
0
votes
2
answers
142
views
CLI to Aid Versioning of Input, Source, and Output
I'm currently working in an environment where I have the following:
Multiple Inputs (with multiple versions)
Source code to generate output (multiple versions)
Output generated by a combination of ...
4
votes
1
answer
965
views
Is undo and redo possible/feasible with two-way data binding (vs uni-directional data flow)?
I'm developing an experimental application for work that requires fully persistent undos and redos. I decided to use react/redux/immutable JS tech stack to solve this problem because I saw it worked ...
- 240
1
vote
2
answers
121
views
Application design for step by step filling information data flow
Suppose, my application consists of many components, where users need to fill theirs information, something like this:
-Select city
`-Select library
`-Select book
`-... a lot of components like ...
- 341
5
votes
3
answers
404
views
Patterns to allow for versatile data-flow hooks in Javascript
I have an application where I'd like to add ways for external modules/components to hook during the processes and data-flow and perform actions/modify data.
For the first requirement—performing ...
- 440
3
votes
0
answers
532
views
Spark supports cyclic data flow
I read on http://spark.apache.org/ that Spark supports cyclic data flow.
How can data flow be cyclic if the RDDs used by Spark are immutable?
I thought the processing done by Spark looks like an ...
- 173
1
vote
1
answer
206
views
How to decide if object should request or receive data?
Deciding whether an object should request data (by calling a function) or receive data (by having a function called from another object) is probably dependent on the exact situation. So how do I ...
- 181
1
vote
1
answer
469
views
Using streams to connect programming languages
I'm trying to run a computation-heavy program that creates an image on a website. Is it possible to compute in C++ and have an output stream that connects to an input stream in Node.js to display an ...
- 13
3
votes
1
answer
334
views
How to efficiently implement this background processing chain?
I am working on an audio software that uses The EchoNest web service to identify and retrieve metadata about audio songs and I would like to have some advice on implementing a background processing ...
- 955
12
votes
3
answers
5k
views
What is a "lifted representation"?
Just ran across this term here:
http://www.codemesh.io/codemesh2014/viktor-klang
"We'll demonstrate the Flow API—a lifted representation—as well as a
pluggable way of transforming the lifted ...
- 4,887
0
votes
1
answer
381
views
Good approach for hundreds of comsumers and big files
I have several files (nearly 1GB each) with data. Data is a string line.
I need to process each of these files with several hundreds of consumers. Each of these consumers does some processing that ...
- 121
1
vote
2
answers
2k
views
How to manage data flow between UI components?
I have been trying to use classes that implement ActionListener to respond to user input. I'm consistently noticing that for an action listener to communicate the event to other objects, it has to ...
- 945
11
votes
1
answer
940
views
Implement FBP / Dataflow programming in VBA?
Intrigued by Flow Based Programming a la J Paul Morrison. I wonder if one can implement FBP in Excel/VBA. I searched quite a bit for a Basic-Lang FBP implementation to no avail. I've looked at some ...
- 231
3
votes
1
answer
586
views
How do I transparently cache data in intermediate stages of processing?
I am working with MATLAB on a model reduction algorithm. It is basically a data processing pipeline.
ckt = generate_ckt(ckt_properties);
freq = generate_fpoints(fconfig);
result = freq_dom_sim(ckt,...
- 155
5
votes
4
answers
640
views
Is it bad practice for a module to contain more information than it needs?
I just wanted to ask for your opinion on a situation that occurs sometimes and which I don't know what would be the most elegant way to solve it.
Here it goes:
We have module A which reads an entry ...
- 295
6
votes
3
answers
2k
views
Real-time Dataflow Programming
Background
Recently, I have been fascinated about the possibilities of dataflow-based programming approaches - in particular, signal/event-based concepts as realized by functional reactive ...
- 14.4k
9
votes
6
answers
4k
views
Do you see an use for "Spreadsheet programming"? [closed]
A while ago I stumbled upon the concept of using spreadsheets (I mean cells and formulas not Macro code) as a way to specify programming logic.
The idea is:
create a spreadsheet with a cleanly defined ...
- 344