A new generalized prime random approximation procedure and some of its applications. We present a new random approximation method that yields the existence of a discrete Beurling prime system mathcal P p 1 , p 2 , dotso which is very close in a certain precise sense to a given non decreasing, right continuous, nonnegative, and unbounded function F . This discretization procedure improves an earlier discrete random approximation method due to H. Diamond, H. Montgomery, and U. Vorhauer Math. Ann. 334 (2006), 1 36 , and refined by W. B. Zhang Math. Ann. 337 (2007), 671 704 . We obtain several applications. Our new method is applied to a question posed by M. Balazard concerning Dirichlet series with a unique zero in their half plane of convergence, to construct examples of very well behaved generalized number systems that solve a recent open question raised by T. Hilberdink and A. Neamah in Int. J. Number Theory 16 05 (2020), 1005 1011 , and to improve the main result from Adv. Math. 370 (2020), Article 107240 , where a Beurling prime system with regular primes but extremely irregular integers was constructed.


Human centric Data Dissemination in the IoP Large scale Modeling and Evaluation. Data management using Device to Device (D2D) communications and opportunistic networks (ONs) is one of the main focuses of human centric pervasive Internet services. In the recently proposed "Internet of People" paradigm, accessing relevant data dynamically generated in the environment nearby is one of the key services. Moreover, personal mobile devices become proxies of their human users while exchanging data in the cyber world and, thus, largely use ONs and D2D communications for exchanging data directly. Recently, researchers have successfully demonstrated the viability of embedding human cognitive schemes in data dissemination algorithms for ONs. In this paper, we consider one such scheme based on the recognition heuristic, a human decision making scheme used to efficiently assess the relevance of data. While initial evidence about its effectiveness is available, the evaluation of its behaviour in large scale settings is still unsatisfactory. To overcome these limitations, we have developed a novel hybrid modelling methodology, which combines an analytical model of data dissemination within small scale communities of mobile users, with detailed simulations of interactions between different communities. This methodology allows us to evaluate the algorithm in large scale city and country wide scenarios. Results confirm the effectiveness of cognitive data dissemination schemes, even when content popularity is very heterogenous.


MagFace A Universal Representation for Face Recognition and Quality Assessment. The performance of face recognition system degrades when the variability of the acquired faces increases. Prior work alleviates this issue by either monitoring the face quality in pre processing or predicting the data uncertainty along with the face feature. This paper proposes MagFace, a category of losses that learn a universal feature embedding whose magnitude can measure the quality of the given face. Under the new loss, it can be proven that the magnitude of the feature embedding monotonically increases if the subject is more likely to be recognized. In addition, MagFace introduces an adaptive mechanism to learn a wellstructured within class feature distributions by pulling easy samples to class centers while pushing hard samples away. This prevents models from overfitting on noisy low quality samples and improves face recognition in the wild. Extensive experiments conducted on face recognition, quality assessments as well as clustering demonstrate its superiority over state of the arts. The code is available at https github.com IrvingMeng MagFace.


CORNET 2.0 A Co Simulation Middleware forRobot Networks. We present a networked co simulation framework for multi robot systems applications. We require a simulation framework that captures both physical interactions and communications aspects to effectively design such complex systems. This is necessary to co design the multi robots' autonomy logic and the communication protocols. The proposed framework extends existing tools to simulate the robot's autonomy and network related aspects. We have used Gazebo with ROS ROS2 to develop the autonomy logic for robots and mininet WiFi as the network simulator to capture the cyber physical systems properties of the multi robot system. This framework addresses the need to seamlessly integrate the two simulation environments by synchronizing mobility and time, allowing for easy migration of the algorithms to real platforms.


A context aware pedestrian trajectory prediction framework for automated vehicles. With the unprecedented shift towards automated urban environments in recent years, a new paradigm is required to study pedestrian behaviour. Studying pedestrian behaviour in futuristic scenarios requires modern data sources that consider both the Automated Vehicle (AV) and pedestrian perspectives. Current open datasets on AVs predominantly fail to account for the latter, as they do not include an adequate number of events and associated details that involve pedestrian and vehicle interactions. To address this issue, we propose using Virtual Reality (VR) data as a complementary resource to current datasets, which can be designed to measure pedestrian behaviour under specific conditions. In this research, we focus on the context aware pedestrian trajectory prediction framework for automated vehicles at mid block unsignalized crossings. For this purpose, we develop a novel multi input network of Long Short Term Memory (LSTM) and fully connected dense layers. In addition to past trajectories, the proposed framework incorporates pedestrian head orientations and distance to the upcoming vehicles as sequential input data. By merging the sequential data with contextual information of the environment, we train a model to predict the future pedestrian trajectory. Our results show that the prediction error and overfitting to the training data are reduced by considering contextual information in the model. To analyze the application of the methods to real AV data, the proposed framework is trained and applied to pedestrian trajectory extracted from an open access video dataset. Finally, by implementing a game theory based model interpretability method, we provide detailed insights and propose recommendations to improve the current automated vehicle sensing systems from a pedestrian oriented point of view.


Personalized Entity Resolution with Dynamic Heterogeneous Knowledge Graph Representations. The growing popularity of Virtual Assistants poses new challenges for Entity Resolution, the task of linking mentions in text to their referent entities in a knowledge base. Specifically, in the shopping domain, customers tend to use implicit utterances (e.g., "organic milk") rather than explicit names, leading to a large number of candidate products. Meanwhile, for the same query, different customers may expect different results. For example, with "add milk to my cart", a customer may refer to a certain organic product, while some customers may want to re order products they regularly purchase. To address these issues, we propose a new framework that leverages personalized features to improve the accuracy of product ranking. We first build a cross source heterogeneous knowledge graph from customer purchase history and product knowledge graph to jointly learn customer and product embeddings. After that, we incorporate product, customer, and history representations into a neural reranking model to predict which candidate is most likely to be purchased for a specific customer. Experiments show that our model substantially improves the accuracy of the top ranked candidates by 24.6 compared to the state of the art product search model.


Convolution inequalities for Besov and Triebel Lizorkin spaces, and applications to convolution semigroups. We establish convolution inequalities for Besov spaces B p,q s and Triebel Lizorkin spaces F p,q s . As an application, we study the mapping properties of convolution semigroups, considered as operators on the function spaces A p,q s , A in B,F . Our results apply to a wide class of convolution semigroups including the Gau ss Weierstra ss semigroup, stable semigroups and heat kernels for higher order powers of the Laplacian ( Delta) m , and we can derive various caloric smoothing estimates.


Deep Metric Learning for Ground Images. Ground texture based localization methods are potential prospects for low cost, high accuracy self localization solutions for robots. These methods estimate the pose of a given query image, i.e. the current observation of the ground from a downward facing camera, in respect to a set of reference images whose poses are known in the application area. In this work, we deal with the initial localization task, in which we have no prior knowledge about the current robot positioning. In this situation, the localization method would have to consider all available reference images. However, in order to reduce computational effort and the risk of receiving a wrong result, we would like to consider only those reference images that are actually overlapping with the query image. For this purpose, we propose a deep metric learning approach that retrieves the most similar reference images to the query image. In contrast to existing approaches to image retrieval for ground images, our approach achieves significantly better recall performance and improves the localization performance of a state of the art ground texture based localization method.


Exponentially Improved Dimensionality Reduction for ell 1 Subspace Embeddings and Independence Testing. Despite many applications, dimensionality reduction in the ell 1 norm is much less understood than in the Euclidean norm. We give two new oblivious dimensionality reduction techniques for the ell 1 norm which improve exponentially over prior ones 1. We design a distribution over random matrices S in mathbb R r times n , where r 2 tilde O(d ( varepsilon delta)) , such that given any matrix A in mathbb R n times d , with probability at least 1 delta , simultaneously for all x , SAx 1 (1 pm varepsilon) Ax 1 . Note that S is linear, does not depend on A , and maps ell 1 into ell 1 . Our distribution provides an exponential improvement on the previous best known map of Wang and Woodruff (SODA, 2019), which required r 2 2 Omega(d) , even for constant varepsilon and delta . Our bound is optimal, up to a polynomial factor in the exponent, given a known 2 sqrt d lower bound for constant varepsilon and delta . 2. We design a distribution over matrices S in mathbb R k times n , where k 2 O(q 2) ( varepsilon 1 q log d) O(q) , such that given any q mode tensor A in ( mathbb R d ) otimes q , one can estimate the entrywise ell 1 norm A 1 from S(A) . Moreover, S S 1 otimes S 2 otimes cdots otimes S q and so given vectors u 1, ldots, u q in mathbb R d , one can compute S(u 1 otimes u 2 otimes cdots otimes u q) in time 2 O(q 2) ( varepsilon 1 q log d) O(q) , which is much faster than the d q time required to form u 1 otimes u 2 otimes cdots otimes u q . Our linear map gives a streaming algorithm for independence testing using space 2 O(q 2) ( varepsilon 1 q log d) O(q) , improving the previous doubly exponential ( varepsilon 1 log d) q O(q) space bound of Braverman and Ostrovsky (STOC, 2010).


Neural Network Structure Design based on N Gauss Activation Function. Recent work has shown that the activation function of the convolutional neural network can meet the Lipschitz condition, then the corresponding convolutional neural network structure can be constructed according to the scale of the data set, and the data set can be trained more deeply, more accurately and more effectively. In this article, we have accepted the experimental results and introduced the core block N Gauss, N Gauss, and Swish (Conv1, Conv2, FC1) neural network structure design to train MNIST, CIFAR10, and CIFAR100 respectively. Experiments show that N Gauss gives full play to the main role of nonlinear modeling of activation functions, so that deep convolutional neural networks have hierarchical nonlinear mapping learning capabilities. At the same time, the training ability of N Gauss on simple one dimensional channel small data sets is equivalent to the performance of ReLU and Swish.


On Newton strata in the B dR Grassmannian. We study parabolic reductions and Newton points of G bundles on the Fargues Fontaine curve and the Newton stratification on the B dR Grassmannian for any reductive group G. Let Bun G be the stack of G bundles on the Fargues Fontaine curve. Our first main result is to show that under the identification of the points of Bun G with Kottwitz's set B(G), the closure relations on the topological space Bun G coincide with the opposite of the usual partial order on B(G). Furthermore, we prove that every non Hodge Newton decomposable Newton stratum in a minuscule affine Schubert cell in the B dR Grassmannian intersects the weakly admissible locus, proving a conjecture of Chen. On the way, we study several interesting properties of parabolic reductions of G bundles, and determine which Newton strata have classical points.


Homological regularities and concavities. This paper concerns homological notions of regularity for noncommutative algebras. Properties of an algebra A are reflected in the regularities of certain (complexes of) A modules. We study the classical Tor regularity and Castelnuovo Mumford regularity, which were generalized from the commutative setting to the noncommutative setting by J o rgensen and Dong Wu. We also introduce two new numerical homological invariants concavity and Artin Schelter regularity. Artin Schelter regular algebras occupy a central position in noncommutative algebra and noncommutative algebraic geometry, and we use these invariants to establish criteria which can be used to determine whether a noetherian connected graded algebra is Artin Schelter regular.


Frame based equipment channel access enhancements in NR unlicensed spectrum for the URLLC transmissions. Ultra reliable low latency communication (URLLC) in 5G New Radio has been originally defined only for licensed spectrum. However, due to new use cases in the Industry 4.0 scenarios, URLLC operation is currently being extended to unlicensed spectrum in the ongoing Release 17 of the 3rd Generation Partnership Project. Although in such controlled environments we can guarantee the absence of any other technology sharing the channel on a long term basis, the uncertainty of obtaining channel access through load based equipment (LBE) or frame based equipment (FBE) can impede with the latency requirements of URLLC. In FBE, the transmitters can be prioritized to support data with different requirements and have lower energy consumption and latency compared to LBE with a big contention window size. In this paper we analyze the performance of FBE in an unlicensed controlled environment through a Markov chain. Based on this analysis, we propose two schemes to improve the URLLC performance in FBE The first scheme allows the transmitters to use multiple fixed frame period (FFP) configurations while the second scheme configures the FFP's starting point of each transmitter based on its priority. The simulations show the benefits of these schemes compared to the URLLC transmission of existing schemes.


Frequency based tension assessment of an inclined cable with complex boundary conditions using the PSO algorithm. The frequency based method is the most commonly used method for measuring cable tension. However, the calculation formulas for the conventional frequency based method are generally based on the ideally hinged or fixed boundary conditions without a comprehensive consideration of the inclination angle, sag extensibility, and flexural stiffness of cables, leading to a significant error in cable tension identification. This study aimed to propose a frequency based method of cable tension identification considering the complex boundary conditions at the two ends of cables using the particle swarm optimization (PSO) algorithm. First, the refined stay cable model was established considering the inclination angle, flexural stiffness, and sag extensibility, as well as the rotational constraint stiffness and lateral support stiffness for the unknown boundaries of cables. The vibration mode equation of the stay cable model was discretized and solved using the finite difference method. Then, a multiparameter identification method based on the PSO algorithm was proposed. This method was able to identify the tension, flexural stiffness, axial stiffness, boundary rotational constraint stiffness, and boundary lateral support stiffness according to the measured multiorder frequencies in a synchronous manner. The feasibility and accuracy of this method were validated through numerical cases. Finally, the proposed approach was applied to the tension identification of the anchor span strands of a suspension bridge (Jindong Bridge) in China. The results of cable tension identification using the proposed method and the existing methods discussed in previous studies were compared with the on site pressure ring measurement results. The comparison showed that the proposed approach had a high accuracy in cable tension identification.


Feature Importance aware Graph Attention Network and Dueling Double Deep Q Network Combined Approach for Critical Node Detection Problems. Detecting critical nodes in sparse networks is important in a variety of application domains. A Critical Node Problem (CNP) aims to find a set of critical nodes from a network whose deletion maximally degrades the pairwise connectivity of the residual network. Due to its general NP hard nature, state of the art CNP solutions are based on heuristic approaches. Domain knowledge and trial and error are usually required when designing such approaches, thus consuming considerable effort and time. This work proposes a feature importance aware graph attention network for node representation and combines it with dueling double deep Q network to create an end to end algorithm to solve CNP for the first time. It does not need any problem specific knowledge or labeled datasets as required by most of existing methods. Once the model is trained, it can be generalized to cope with various types of CNPs (with different sizes and topological structures) without re training. Extensive experiments on 28 real world networks show that the proposed method is highly comparable to state of the art methods. It does not require any problem specific knowledge and, hence, can be applicable to many applications including those impossible ones by using the existing approaches. It can be combined with some local search methods to further improve its solution quality. Extensive comparison results are given to show its effectiveness in solving CNP.


Linking Enhanced Pre Training for Table Semantic Parsing. Recently pre training models have significantly improved the performance of various NLP tasks by leveraging large scale text corpora to improve the contextual representation ability of the neural network. The large pre training language model has also been applied in the area of table semantic parsing. However, existing pre training approaches have not carefully explored explicit interaction relationships between a question and the corresponding database schema, which is a key ingredient for uncovering their semantic and structural correspondence. Furthermore, the question aware representation learning in the schema grounding context has received less attention in pre training objective.To alleviate these issues, this paper designs two novel pre training objectives to impose the desired inductive bias into the learned representations for table pre training. We further propose a schema aware curriculum learning approach to mitigate the impact of noise and learn effectively from the pre training data in an easy to hard manner. We evaluate our pre trained framework by fine tuning it on two benchmarks, Spider and SQUALL. The results demonstrate the effectiveness of our pre training objective and curriculum compared to a variety of baselines.


Far Field Super Resolution Imaging By Nonlinear Excited Evanescent Waves. Abbe's resolution limit, one of the best known physical limitations, poses a great challenge for any wave systems in imaging, wave transport, and dynamics. Originally formulated in linear optics, this Abbe's limit can be broken using nonlinear optical interactions. Here we extend the Abbe theory into a nonlinear regime and experimentally demonstrate a far field, label free, and scan free super resolution imaging technique based on nonlinear four wave mixing to retrieve near field scattered evanescent waves, achieving sub wavelength resolution of lambda 15.6 . This method paves the way for application in biomedical imaging, semiconductor metrology, and photolithography.


Dynamic traffic assignment in a corridor network Optimum versus Equilibrium. This study investigates dynamic system optimal (DSO) and dynamic user equilibrium (DUE) traffic assignment of departure arrival time choices in a corridor network. The morning commute problems with a many to one pattern of origin destination demand and the evening commute problems with a one to many pattern are considered. Specifically, a novel approach to derive closed form solutions for both DSO and DUE problems is developed. We first derive a closed form solution to the DSO problem based on the regularities of the cost and flow variables at an optimal state. By utilizing this solution, we prove that the queuing delay at a bottleneck in a DUE solution is equal to an optimal toll that eliminates the queue in a DSO solution under certain conditions of a schedule delay function. This enables us to derive a closed form DUE solution by using the DSO solution. We also show the theoretical relationship between the DSO and DUE assignment. Numerical examples are provided to illustrate and verify the analytical results.


RASEC Rescaling Acquisition Strategy with Energy Constraints under SE OU Fusion Kernel for Active Trachea Palpation and Incision Recommendation in Laryngeal Region. A novel palpation based incision detection strategy in the laryngeal region, potentially for robotic tracheotomy, is proposed in this letter. A tactile sensor is introduced to measure tissue hardness in the specific laryngeal region by gentle contact. The kernel fusion method is proposed to combine the Squared Exponential (SE) kernel with Ornstein Uhlenbeck (OU) kernel to figure out the drawbacks that the existing kernel functions are not sufficiently optimal in this scenario. Moreover, we further regularize exploration factor and greed factor, and the tactile sensor's moving distance and the robotic base link's rotation angle during the incision localization process are considered as new factors in the acquisition strategy. We conducted simulation and physical experiments to compare the newly proposed algorithm Rescaling Acquisition Strategy with Energy Constraints (RASEC) in trachea detection with current palpation based acquisition strategies. The result indicates that the proposed acquisition strategy with fusion kernel can successfully localize the incision with the highest algorithm performance (Average Precision 0.932, Average Recall 0.973, Average F1 score 0.952). During the robotic palpation process, the cumulative moving distance is reduced by 50 , and the cumulative rotation angle is reduced by 71.4 with no sacrifice in the comprehensive performance capabilities. Therefore, it proves that RASEC can efficiently suggest the incision zone in the laryngeal region and greatly reduced the energy loss.


Theoretical Chemistry Course for Students in Chemistry. In this work, the teaching content of a theoretical chemistry (TC) course is reformed, establishing a theoretical contents from micro to macro system, and comprehensively introducing the theory of chemical reaction to undergraduate students in chemistry. In order to develop such TC course based on the general physical chemistry course, we focus on the last mile problem between the physics and chemistry courses to train the critical thinking of undergraduate students in chemistry. To clearly show this, a reduction scheme of polymer molecular dynamics was discussed as an example, which shows a different theoretical content in polymer chemistry. Moreover, we propose a series of experiences and dependent measures that can provide information regarding students' levels of knowledge and understanding. This assessment quiz was designed to test students on the fundamental concepts and applications of TC, such as dynamics, statistical ensemble, kinetics, and so on. From the actual teaching for 36 students, it was found that these students performed significantly improvement from the present TC content. Further analysis of each individual question revealed that approximately two third of the students learn new knowledge. Although the present TC course might be considered to be a certain degree of difficulty for chemists, these analyses show that students can effectively accept these complicated concepts.


Self regulating turbulence. A landmark of out of equilibrium physics is Kolmogorov's phenomenological theory of turbulence. However, the past 20 years have provided evidence of a new, universal type of turbulence cascade, which does not abide to Kolmogorov physics. To address this issue, we revise the classical Kolmogorov cascade, by superimposing on it a mechanism of active information exchange between large and small scales. The new theory yields predictions for the dissipation rate, integral length scale and turbulence kinetic energy, as well as a criterion for the transition of the system from the new, to the classical physics in decaying turbulence. The assumptions and predictions are validated using large scale simulations and data from the literature.


Graph Sanitation with Application to Node Classification. The past decades have witnessed the prosperity of graph mining, with a multitude of sophisticated models and algorithms designed for various mining tasks, such as ranking, classification, clustering and anomaly detection. Generally speaking, the vast majority of the existing works aim to answer the following question, that is, given a graph, what is the best way to mine it? In this paper, we introduce the graph sanitation problem, to answer an orthogonal question. That is, given a mining task and an initial graph, what is the best way to improve the initially provided graph? By learning a better graph as part of the input of the mining model, it is expected to benefit graph mining in a variety of settings, ranging from denoising, imputation to defense. We formulate the graph sanitation problem as a bilevel optimization problem, and further instantiate it by semi supervised node classification, together with an effective solver named GaSoliNe. Extensive experimental results demonstrate that the proposed method is (1) broadly applicable with respect to different graph neural network models and flexible graph modification strategies, (2) effective in improving the node classification accuracy on both the original and contaminated graphs in various perturbation scenarios. In particular, it brings up to 25 performance improvement over the existing robust graph neural network methods.


General self similar solutions of diffusion equation and related constructions. Transport phenomena plays an important role in science and technology. In the wide variety of applications both advection and diffusion may appear. Regarding diffusion, for long times, different type of decay rates are possible for different non equilibrium systems. After summarizing the existing solutions of the regular diffusion equation, we present not so well known solution derived from three different trial functions, as a key point we present a family of solutions for the case of infinite horizon. By this we tried to make a step toward understanding the different long time decays for different diffusive systems.


LocoProp Enhancing BackProp via Local Loss Optimization. Second order methods have shown state of the art performance for optimizing deep neural networks. Nonetheless, their large memory requirement and high computational complexity, compared to first order methods, hinder their versatility in a typical low budget setup. This paper introduces a general framework of layerwise loss construction for multilayer neural networks that achieves a performance closer to second order methods while utilizing first order optimizers only. Our methodology lies upon a three component loss, target, and regularizer combination, for which altering each component results in a new update rule. We provide examples using squared loss and layerwise Bregman divergences induced by the convex integral functions of various transfer functions. Our experiments on benchmark models and datasets validate the efficacy of our new approach, reducing the gap between first order and second order optimizers.


Efficient Visual Recognition with Deep Neural Networks A Survey on Recent Advances and New Directions. Visual recognition is currently one of the most important and active research areas in computer vision, pattern recognition, and even the general field of artificial intelligence. It has great fundamental importance and strong industrial needs. Deep neural networks (DNNs) have largely boosted their performances on many concrete tasks, with the help of large amounts of training data and new powerful computation resources. Though recognition accuracy is usually the first concern for new progresses, efficiency is actually rather important and sometimes critical for both academic research and industrial applications. Moreover, insightful views on the opportunities and challenges of efficiency are also highly required for the entire community. While general surveys on the efficiency issue of DNNs have been done from various perspectives, as far as we are aware, scarcely any of them focused on visual recognition systematically, and thus it is unclear which progresses are applicable to it and what else should be concerned. In this paper, we present the review of the recent advances with our suggestions on the new possible directions towards improving the efficiency of DNN related visual recognition approaches. We investigate not only from the model but also the data point of view (which is not the case in existing surveys), and focus on three most studied data types (images, videos and points). This paper attempts to provide a systematic summary via a comprehensive survey which can serve as a valuable reference and inspire both researchers and practitioners who work on visual recognition problems.


PANDADB A Distributed Graph Database System to Query Unstructured Data in Big Graph. Unstructured data, such as images and videos, have grown significantly. The interconnected unstructured data can be viewed as the properties of nodes in graphs. End users usually query graph data and unstructured data together in different real world applications. Some systems and techniques are proposed to meet such demands. However, most of the previous works execute various tasks in different systems and lose the possibility to optimize such queries in one engine. In this work, we build a native graph database, namely PandaDB, to support querying unstructured data in the graph. We first introduce CypherPlus, a query language to enable users to express complex graph queries to understand the semantic of unstructured data. Next, we develop a cost model and related query optimization techniques to speed up the unstructured data processing as well as the graph query processing. In addition, we optimize the data storage and index to speed up the query processing in a distributed setting. The PandaDB extends the graph database Neo4j implementation and provides the open source version for commercial use in the cloud. The results show PandaDB can support a large scale of unstructured data query processing in a graph, e.g., more than a billion unstructured data items. PandaDB is open source and widely used in different industrial applications from FinTech, Knowledge Graph, and Social network management to manage large scale graphs with a huge amount of unstructured data.


A review paper of bio inspired environmental adaptive and precisely maneuverable soft robots. This paper summarizes the most recent research in soft robotic field from the factors of material, actuation, mechanicsproperty, dimension scale and architecture, and then presents the relations among the functionalities, manufacturing process and the factors mentioned above.


The full group of isometries of some compact Lie groups endowed with a bi invariant metric. We describe the full group of isometries of absolutely simple, compact, connected real Lie groups, of SO(4) and of U(n), endowed with suitable bi invariant Riemannian metrics.


Causal Knowledge Guided Societal Event Forecasting. Data driven societal event forecasting methods exploit relevant historical information to predict future events. These methods rely on historical labeled data and cannot accurately predict events when data are limited or of poor quality. Studying causal effects between events goes beyond correlation analysis and can contribute to a more robust prediction of events. However, incorporating causality analysis in data driven event forecasting is challenging due to several factors (i) Events occur in a complex and dynamic social environment. Many unobserved variables, i.e., hidden confounders, affect both potential causes and outcomes. (ii) Given spatiotemporal non independent and identically distributed (non IID) data, modeling hidden confounders for accurate causal effect estimation is not trivial. In this work, we introduce a deep learning framework that integrates causal effect estimation into event forecasting. We first study the problem of Individual Treatment Effect (ITE) estimation from observational event data with spatiotemporal attributes and present a novel causal inference model to estimate ITEs. We then incorporate the learned event related causal information into event prediction as prior knowledge. Two robust learning modules, including a feature reweighting module and an approximate constraint loss, are introduced to enable prior knowledge injection. We evaluate the proposed causal inference model on real world event datasets and validate the effectiveness of proposed robust learning modules in event prediction by feeding learned causal information into different deep learning methods. Experimental results demonstrate the strengths of the proposed causal inference model for ITE estimation in societal events and showcase the beneficial properties of robust learning modules in societal event forecasting.


Fake News and Phishing Detection Using a Machine Learning Trained Expert System. Expert systems have been used to enable computers to make recommendations and decisions. This paper presents the use of a machine learning trained expert system (MLES) for phishing site detection and fake news detection. Both topics share a similar goal to design a rule fact network that allows a computer to make explainable decisions like domain experts in each respective area. The phishing website detection study uses a MLES to detect potential phishing websites by analyzing site properties (like URL length and expiration time). The fake news detection study uses a MLES rule fact network to gauge news story truthfulness based on factors such as emotion, the speaker's political affiliation status, and job. The two studies use different MLES network implementations, which are presented and compared herein. The fake news study utilized a more linear design while the phishing project utilized a more complex connection structure. Both networks' inputs are based on commonly available data sets.


A Comprehensive Study on Torchvision Pre trained Models for Fine grained Inter species Classification. This study aims to explore different pre trained models offered in the Torchvision package which is available in the PyTorch library. And investigate their effectiveness on fine grained images classification. Transfer Learning is an effective method of achieving extremely good performance with insufficient training data. In many real world situations, people cannot collect sufficient data required to train a deep neural network model efficiently. Transfer Learning models are pre trained on a large data set, and can bring a good performance on smaller datasets with significantly lower training time. Torchvision package offers us many models to apply the Transfer Learning on smaller datasets. Therefore, researchers may need a guideline for the selection of a good model. We investigate Torchvision pre trained models on four different data sets 10 Monkey Species, 225 Bird Species, Fruits 360, and Oxford 102 Flowers. These data sets have images of different resolutions, class numbers, and different achievable accuracies. We also apply their usual fully connected layer and the Spinal fully connected layer to investigate the effectiveness of SpinalNet. The Spinal fully connected layer brings better performance in most situations. We apply the same augmentation for different models for the same data set for a fair comparison. This paper may help future Computer Vision researchers in choosing a proper Transfer Learning model.


Continuity for the one dimensional centered Hardy Littlewood maximal operator at the derivative level. We prove the continuity of the map f mapsto (Mf)' from W 1,1 ( mathbb R ) to L 1( mathbb R ) , where M is the centered Hardy Littlewood maximal operator. This solves a question posed by Carneiro, Madrid and Pierce.


Flexible forward improvement iteration for infinite time horizon Markovian optimal stopping problems. In this paper, we propose an extension of the forward improvement iteration algorithm, originally introduced in Irle (2006) and recently reconsidered in Miclo and Villeneuve (2021). The main new ingredient is a flexible window parameter describing the look ahead distance in the improvement step. We consider the framework of a Markovian optimal stopping problem in discrete time with random discounting and infinite time horizon. We prove convergence and show that the additional flexibility may significantly reduce the runtime.


Convergence Rate Analysis of Accelerated Forward Backward Algorithm with Generalized Nesterov Momentum Scheme. Nesterov's accelerated forward backward algorithm (AFBA) is an efficient algorithm for solving a class of two term convex optimization models consisting of a differentiable function with a Lipschitz continuous gradient plus a nondifferentiable function with a closed form of its proximity operator. It has been shown that the iterative sequence generated by AFBA with a modified Nesterov's momentum scheme converges to a minimizer of the objective function with an o left( frac 1 k 2 right) convergence rate in terms of the function value (FV convergence rate) and an o left( frac 1 k right) convergence rate in terms of the distance between consecutive iterates (DCI convergence rate). In this paper, we propose a more general momentum scheme with an introduced power parameter omega in(0,1 and show that AFBA with the proposed momentum scheme converges to a minimizer of the objective function with an o left( frac 1 k 2 omega right) FV convergence rate and an o left( frac 1 k omega right) DCI convergence rate. The generality of the proposed momentum scheme provides us a variety of parameter selections for different scenarios, which makes the resulting algorithm more flexible to achieve better performance. We then employ AFBA with the proposed momentum scheme to solve the smoothed hinge loss ell 1 support vector machine model. Numerical results demonstrate that the proposed generalized momentum scheme outperforms two existing momentum schemes.


physics.flu-dyn math.DS physics.class-ph physics.plasm-ph

Radiation induced instability of a finite chord Nemtsov membrane. We consider a problem of stability of a membrane of an infinite span and a finite chord length, submerged in a uniform flow of finite depth with free surface. In the shallow water approximation, Nemtsov (1985) has shown that an infinite chord membrane is susceptible to flutter instability due to excitation of long gravity waves on the free surface if the velocity of the flow exceeds the phase velocity of the waves and related this phenomenon with the anomalous Doppler effect. In the present work we derive a full nonlinear eigenvalue problem for an integro differential equation for the finite chord Nemtsov membrane in the finite depth flow. In the shallow and deep water limits we develop a perturbation theory in the small added mass ratio parameter acting as an effective dissipation, to find explicit analytical expressions for the frequencies and the growth rates of the membrane modes coupled to the surface waves. We find an intricate pattern of instability pockets in the parameter space and describe it analytically. The case of an arbitrary depth flow with free surface requires numerical solution of a new non polynomial nonlinear eigenvalue problem. We propose an original approach combining methods of complex analysis and residue calculus, Galerkin discretization, Newton method and parallelization techniques implemented in MATLAB to produce high accuracy stability diagrams within an unprecedentedly wide range of system's parameters. We believe that the Nemtsov membrane plays the same paradigmatic role for understanding radiation induced instabilities as the Lamb oscillator coupled to a string has played for understanding radiation damping.


Birational properties of tangent to the identity germs without non degenerate singular directions. We provide a family of isolated tangent to the identity germs f ( mathbb C 3,0) to ( mathbb C 3,0) which possess only degenerate characteristic directions, and for which the lift of f to any modification (with suitable properties) has only degenerate characteristic directions. This is in sharp contrast with the situation in dimension 2 , where any isolated tangent to the identity germ f admits a modification where the lift of f has a non degenerate characteristic direction. We compare this situation with the resolution of singularities of the infinitesimal generator of f , showing that this phenomenon is not related to the non existence of complex separatrices for vector fields of Gomez Mont and Luengo. Finally, we describe the set of formal f invariant curves, and the associated parabolic manifolds, using the techniques recently developed by L 'opez Hernanz, Raissy, Rib 'on, Sanz S 'anchez, Vivas.


ModelCI e Enabling Continual Learning in Deep Learning Serving Systems. MLOps is about taking experimental ML models to production, i.e., serving the models to actual users. Unfortunately, existing ML serving systems do not adequately handle the dynamic environments in which online data diverges from offline training data, resulting in tedious model updating and deployment works. This paper implements a lightweight MLOps plugin, termed ModelCI e (continuous integration and evolution), to address the issue. Specifically, it embraces continual learning (CL) and ML deployment techniques, providing end to end supports for model updating and validation without serving engine customization. ModelCI e includes 1) a model factory that allows CL researchers to prototype and benchmark CL models with ease, 2) a CL backend to automate and orchestrate the model updating efficiently, and 3) a web interface for an ML team to manage CL service collaboratively. Our preliminary results demonstrate the usability of ModelCI e, and indicate that eliminating the interference between model updating and inference workloads is crucial for higher system efficiency.


A generalized algorithm and framework for online 3 dimensional bin packing in an automated sorting center. Online 3 dimensional bin packing problem (O3D BPP) is getting renewed prominence due to the industrial automation brought by Industry 4.0. However, due to limited attention in the past and its challenging nature, a good approximate algorithm is in scarcity as compared to 1D or 2D problems. This paper considers real time O 3 D BPP of cuboidal boxes with partial information (look ahead) in an automated robotic sorting center. We present two rolling horizon mixed integer linear programming (MILP) cum heuristic based algorithms MPack (for bench marking) and MPackLite (for real time deployment). Additionally, we present a framework OPack that adapts and improves the performance of BP heuristics by utilizing information in an online setting with a look ahead. We then perform a comparative analysis of BP heuristics (with and without OPack), MPack, and MPackLite on synthetic and industry provided data with increasing look ahead. MPackLite and the baseline heuristics perform within bounds of robot operations and thus, can be used in real time.


Understanding and Mitigating Multi Sided Exposure Bias in Recommender Systems. Fairness is a critical system level objective in recommender systems that has been the subject of extensive recent research. It is especially important in multi sided recommendation platforms where it may be crucial to optimize utilities not just for the end user, but also for other actors such as item sellers or producers who desire a fair representation of their items. Existing solutions do not properly address various aspects of multi sided fairness in recommendations as they may either solely have one sided view (i.e. improving the fairness only for one side), or do not appropriately measure the fairness for each actor involved in the system. In this thesis, I aim at first investigating the impact of unfair recommendations on the system and how these unfair recommendations can negatively affect major actors in the system. Then, I seek to propose solutions to tackle the unfairness of recommendations. I propose a rating transformation technique that works as a pre processing step before building the recommendation model to alleviate the inherent popularity bias in the input data and consequently to mitigate the exposure unfairness for items and suppliers in the recommendation lists. Also, as another solution, I propose a general graph based solution that works as a post processing approach after recommendation generation for mitigating the multi sided exposure bias in the recommendation results. For evaluation, I introduce several metrics for measuring the exposure fairness for items and suppliers, and show that these metrics better capture the fairness properties in the recommendation results. I perform extensive experiments to evaluate the effectiveness of the proposed solutions. The experiments on different publicly available datasets and comparison with various baselines confirm the superiority of the proposed solutions in improving the exposure fairness for items and suppliers.


True Few Shot Learning with Prompts A Real World Perspective. Prompt based approaches are strong at few shot learning. However, Perez et al. (2021) have recently cast doubt on their performance because they had difficulty getting good results in a "true" few shot setting in which prompts and hyperparameters cannot be tuned on a dev set. In view of this, we conduct an extensive study of PET, a method that combines textual instructions with example based finetuning. We show that, if correctly configured, PET performs strongly in a true few shot setting, i.e., without a dev set. Crucial for this strong performance is PET's ability to intelligently handle multiple prompts. We then put our findings to a real world test by running PET on RAFT, a benchmark of tasks taken directly from realistic NLP applications for which no labeled dev or test sets are available. PET achieves a new state of the art on RAFT and performs close to non expert humans for 7 out of 11 tasks. These results demonstrate that prompt based learners like PET excel at true few shot learning and underpin our belief that learning from instructions will play an important role on the path towards human like few shot learning capabilities.


Imaginative Walks Generative Random Walk Deviation Loss for Improved Unseen Learning Representation. We propose a novel loss for generative models, dubbed as GRaWD (Generative Random Walk Deviation), to improve learning representations of unexplored visual spaces. Quality learning representation of unseen classes (or styles) is critical to facilitate novel image generation and better generative understanding of unseen visual classes, i.e., zero shot learning (ZSL). By generating representations of unseen classes based on their semantic descriptions, e.g., attributes or text, generative ZSL attempts to differentiate unseen from seen categories. The proposed GRaWD loss is defined by constructing a dynamic graph that includes the seen class style centers and generated samples in the current minibatch. Our loss initiates a random walk probability from each center through visual generations produced from hallucinated unseen classes. As a deviation signal, we encourage the random walk to eventually land after t steps in a feature representation that is difficult to classify as any of the seen classes. We demonstrate that the proposed loss can improve unseen class representation quality inductively on text based ZSL benchmarks on CUB and NABirds datasets and attribute based ZSL benchmarks on AWA2, SUN, and aPY datasets. In addition, we investigate the ability of the proposed loss to generate meaningful novel visual art on the WikiArt dataset. The results of experiments and human evaluations demonstrate that the proposed GRaWD loss can improve StyleGAN1 and StyleGAN2 generation quality and create novel art that is significantly more preferable. Our code is made publicly available at https github.com Vision CAIR GRaWD.


Exploring the efficacy of neural networks for trajectory compression and the inverse problem. In this document, a neural network is employed in order to estimate the solution of the initial value problem in the context of non linear trajectories. Such trajectories can be subject to gravity, thrust, drag, centrifugal force, temperature, ambient air density and pressure. First, we generate a grid of trajectory points given a specified uniform density as a design parameter and then we investigate the performance of a neural network in a compression and inverse problem task the network is trained to predict the initial conditions of the dynamics model we used in the simulation, given a target point in space. We investigate this as a regression task, with error propagation in consideration. For target points, up to a radius of 2 kilometers, the model is able to accurately predict the initial conditions of the trajectories, with sub meter deviation. This simulation based training process and novel real world evaluation method is capable of computing trajectories of arbitrary dimensions.


Unsupervised detection of mouse behavioural anomalies using two stream convolutional autoencoders. This paper explores the application of unsupervised learning to detecting anomalies in mouse video data. The two models presented in this paper are a dual stream, 3D convolutional autoencoder (with residual connections) and a dual stream, 2D convolutional autoencoder. The publicly available dataset used here contains twelve videos of single home caged mice alongside frame level annotations. Under the pretext that the autoencoder only sees normal events, the video data was handcrafted to treat each behaviour as a pseudo anomaly thereby eliminating them from the others during training. The results are presented for one conspicuous behaviour (hang) and one inconspicuous behaviour (groom). The performance of these models is compared to a single stream autoencoder and a supervised learning model, which are both based on the custom CAE. Both models are also tested on the CUHK Avenue dataset were found to perform as well as some state of the art architectures.


The Walker Abel Jacobi map descends. For a complex projective manifold, Walker has defined a regular homomorphism lifting Griffiths' Abel Jacobi map on algebraically trivial cycle classes to a complex abelian variety, which admits a finite homomorphism to the Griffiths intermediate Jacobian. Recently Suzuki gave an alternate, Hodge theoretic, construction of this Walker Abel Jacobi map. We provide a third construction based on a general lifting property for surjective regular homomorphisms, and prove that the Walker Abel Jacobi map descends canonically to any field of definition of the complex projective manifold. In addition, we determine the image of the l adic Bloch map restricted to algebraically trivial cycle classes in terms of the coniveau filtration.


Linear Nearest Neighbor Flocks with All Distinct Agents. This paper analyzes the global dynamics of 1 dimensional agent arrays with nearest neighbor linear couplings. The equations of motion are second order linear ODEs with constant coeffcients. The novel part of this research is that the couplings are different for each distinct agent. We allow the forces to depend on the positions and velocity (damping terms) but the magnitudes of both the position and velocity couplings are different for each agent. We, also, do not assume that the forces are "Newtonian" (i.e. the force due to A on B equals the minus the force of B on A) as this assumption does not apply to certain situations, such as traffic modeling. For example, driver A reacting to driver B does not imply the opposite reaction in driver B. There are no known analytical means to solve these systems, even though they are linear, and so relatively little is known about them. This paper is a generalization of previous work that computed the global dynamics of 1 dimensional sequences of identical agents 3 assuming periodic boundary conditions. In this paper, we push that method further, similar to 2 , and use an extended periodic boundary condition to to gain quantitative insights to the systems under consideration. We find that we can approximate the global dynamics of such a system by carefully analyzing the low frequency behavior of the system with (generalized) periodic boundary conditions.


On N Unital Functions. Let N be a positive integer. We say a non constant rational function U(x) in mathbb C (x) is N emph unital if all the zeros and poles of both U(x) and 1 U(x) are either 0 or N th roots of unity. These functions are called admissible functions by Au in a recent paper arXiv 2007.03957 and used to study some central binomial series of Ap 'ery type via their iterated integral expression related to multiple polylogrithms and colored multiple zeta values. In this paper we determine the complete set of these functions for N le 4 by elementary method, and briefly study some cases at level 5.


A Comparative Approach to Explainable Artificial Intelligence Methods in Application to High Dimensional Electronic Health Records Examining the Usability of XAI. Explainable Artificial Intelligence (XAI) is a rising field in AI. It aims to produce a demonstrative factor of trust, which for human subjects is achieved through communicative means, which Machine Learning (ML) algorithms cannot solely produce, illustrating the necessity of an extra layer producing support to the model output. When approaching the medical field, we can see challenges arise when dealing with the involvement of human subjects, the ideology behind trusting a machine to tend towards the livelihood of a human poses an ethical conundrum leaving trust as the basis of the human expert in acceptance to the machines decision. The aim of this paper is to apply XAI methods to demonstrate the usability of explainable architectures as a tertiary layer for the medical domain supporting ML predictions and human expert opinion, XAI methods produce visualization of the feature contribution towards a given models output on both a local and global level. The work in this paper uses XAI to determine feature importance towards high dimensional data driven questions to inform domain experts of identifiable trends with a comparison of model agnostic methods in application to ML algorithms. The performance metrics for a glass box method is also provided as a comparison against black box capability for tabular data. Future work will aim to produce a user study using metrics to evaluate human expert usability and opinion of the given models.


Mitigating Power Attacks through Fine Grained Instruction Reordering. Side channel attacks are a security exploit that take advantage of information leakage. They use measurement and analysis of physical parameters to reverse engineer and extract secrets from a system. Power analysis attacks in particular, collect a set of power traces from a computing device and use statistical techniques to correlate this information with the attacked application data and source code. Counter measures like just in time compilation, random code injection and instruction descheduling obfuscate the execution of instructions to reduce the security risk. Unfortunately, due to the randomness and excess instructions executed by these solutions, they introduce large overheads in performance, power and area. In this work we propose a scheduling algorithm that dynamically reorders instructions in an out of order processor to provide obfuscated execution and mitigate power analysis attacks with little to no effect on the performance, power or area of the processor. We exploit the time between operand availability of critical instructions (slack) to create high performance random schedules without requiring additional instructions or static prescheduling. Further, we perform an extended security analysis using different attacks. We highlight the dangers of using incorrect adversarial assumptions, which can often lead to a false sense of security. In that regard, our advanced security metric demonstrates improvements of 34 times , while our basic security evaluation shows results up to 261 times . Moreover, our system achieves performance within 96 on average, of the baseline unprotected processor.


Dynamics of small heavy particles in homogeneous turbulence a Lagrangian experimental study. We investigate the behavior of microscopic heavy particles settling in homogeneous air turbulence. The regimes are relevant to the airborne transport of dust and droplets the Taylor microscale Reynolds number is Re 289 462, the Kolmogorov scale Stokes number is St 1.2 13, and the Kolmogorov acceleration is comparable to the gravitational acceleration (i.e., the Froude number Fr O(1)). We use high speed laser imaging to track the particles and simultaneously characterize the air velocity field, resolving all relevant spatio temporal scales. The role of the flow sampled by the particles is spotlighted. In the present range of parameters, the particle settling velocity is enhanced proportionally to the velocity scale of the turbulence. Both gravity and inertia reduce the velocity fluctuations of the particles compared to the fluid while they have competing effect on the particle acceleration, through the crossing trajectories and inertial filtering mechanisms, respectively. The preferential sampling of high strain low vorticity regions is measurable, but its impact on the global statistics is moderate. The inertial particles have large relative velocity at small separations, which increases their pair dispersion however, gravity offsets this effect by causing them to experience fluid velocities that decorrelate faster in time compared to tracers. Based on the observations, we derive an analytical model to predict the particle velocity and acceleration variances for arbitrary St, Fr, and Re. This agrees well with the present observations and previous simulations and captures the respective effects of inertia and gravity, both of which play crucial roles in the transport.


Fourier Jacobi cycles and arithmetic relative trace formula (with an appendix by Chao Li and Yihang Zhu). In this article, we develop an arithmetic analogue of Fourier Jacobi period integrals for a pair of unitary groups of equal rank. We construct the so called Fourier Jacobi cycles, which are algebraic cycles on the product of unitary Shimura varieties and abelian varieties. We propose the arithmetic Gan Gross Prasad conjecture for these cycles, which is related to central derivatives of certain Rankin Selberg L functions, and develop a relative trace formula approach toward this conjecture. As a necessary ingredient, we propose the conjecture of the corresponding arithmetic fundamental lemma, and confirm it for unitary groups of rank at most two and for the minuscule case.


Hamilton Jacobi equations with their Hamiltonians depending Lipschitz continuously on the unknown. We study the Hamilton Jacobi equations H(x,Du,u) 0 in M and partial u partial t H(x,D xu,u) 0 in M times(0, infty) , where the Hamiltonian H H(x,p,u) depends Lipschitz continuously on the variable u . In the framework of the semicontinuous viscosity solutions due to Barron Jensen, we establish the comparison principle, existence theorem, and representation formula as value functions for extended real valued, lower semicontinuous solutions for the Cauchy problem. We also establish some results on the long time behavior of solutions for the Cauchy problem and classification of solutions for the stationary problem.


Smooth Implicit Hybrid Upwinding for Compositional Multiphase Flow in Porous Media. In subsurface multiphase flow simulations, poor nonlinear solver performance is a significant runtime sink. The system of fully implicit mass balance equations is highly nonlinear and often difficult to solve for the nonlinear solver, generally Newton( Raphson). Strong nonlinearities can cause Newton iterations to converge very slowly. This frequently results in time step cuts, leading to computationally expensive simulations. Much literature has looked into how to improve the nonlinear solver through enhancements or safeguarding updates. In this work, we take a different approach we aim to improve convergence with a smoother finite volume discretization scheme which is more suitable for the Newton solver. Building on recent work, we propose a novel total velocity hybrid upwinding scheme with weighted average flow mobilities (WA HU TV) that is unconditionally monotone and extends to compositional multiphase simulations. Analyzing the solution space of a one cell problem, we demonstrate the improved properties of the scheme and explain how it leverages the advantages of both phase potential upwinding and arithmetic averaging. This results in a flow subproblem that is smooth with respect to changes in the sign of phase fluxes, and is well behaved when phase velocities are large or when co current viscous forces dominate. Additionally, we propose a WA HU scheme with a total mass (WA HU TM) formulation that includes phase densities in the weighted averaging. The proposed WA HU TV consistently outperforms existing schemes, yielding benefits from 5 to over 50 reduction in nonlinear iterations. The WA HU TM scheme also shows promising results in some cases leading to even more efficiency. However, WA HU TM can occasionally also lead to convergence issues. Overall, based on the current results, we recommend the adoption of the WA HU TV scheme as it is highly efficient and robust.


Datasets for Studying Generalization from Easy to Hard Examples. We describe new datasets for studying generalization from easy to hard examples.


iContractBot A Chatbot for Smart Contracts' Specification and Code Generation. Recently, Blockchain technology adoption has expanded to many application areas due to the evolution of smart contracts. However, developing smart contracts is non trivial and challenging due to the lack of tools and expertise in this field. A promising solution to overcome this issue is to use Model Driven Engineering (MDE), however, using models still involves a learning curve and might not be suitable for non technical users. To tackle this challenge, chatbot or conversational interfaces can be used to assess the non technical users to specify a smart contract in gradual and interactive manner. In this paper, we propose iContractBot, a chatbot for modeling and developing smart contracts. Moreover, we investigate how to integrate iContractBot with iContractML, a domain specific modeling language for developing smart contracts, and instantiate intention models from the chatbot. The iContractBot framework provides a domain specific language (DSL) based on the user intention and performs model to text transformation to generate the smart contract code. A smart contract use case is presented to demonstrate how iContractBot can be utilized for creating models and generating the deployment artifacts for smart contracts based on a simple conversation.


A Certified Reduced Basis Method for Linear Parametrized Parabolic Optimal Control Problems in Space Time Formulation. In this work, we propose to efficiently solve time dependent parametrized optimal control problems governed by parabolic partial differential equations through the certified reduced basis method. In particular, we will exploit an error estimator procedure, based on easy to compute quantities which guarantee a rigorous and efficient bound for the error of the involved variables. First of all, we propose the analysis of the problem at hand, proving its well posedness thanks to Ne v c as Babu v s ka theory for distributed and boundary controls in a space time formulation. Then, we derive error estimators to apply a Greedy method during the offline stage, in order to perform, during the online stage, a Galerkin projection onto a low dimensional space spanned by properly chosen high fidelity solutions. We tested the error estimators on two model problems governed by a Graetz flow a physical parametrized distributed optimal control problem and a boundary optimal control problem with physical and geometrical parameters. The results have been compared to a previously proposed bound, based on the exact computation of the Babu v s ka inf sup constant, in terms of reliability and computational costs. We remark that our findings still hold in the steady setting and we propose a brief insight also for this simpler formulation.


Some Braces of Cardinality p 4 and Related Hopf Galois Extensions. We describe all mathbb F p braces of cardinality p 4 which are not right nilpotent. Our solution illustrates a general way of investigating mathbb F p braces of cardinality p n with a given multiplicative group. The constructed braces are left nilpotent, solvable and prime, and they also contain a non zero strongly nilpotent ideal.


Learning Meta Pattern for Face Anti Spoofing. Face Anti Spoofing (FAS) is essential to secure face recognition systems and has been extensively studied in recent years. Although deep neural networks (DNNs) for the FAS task have achieved promising results in intra dataset experiments with similar distributions of training and testing data, the DNNs' generalization ability is limited under the cross domain scenarios with different distributions of training and testing data. To improve the generalization ability, recent hybrid methods have been explored to extract task aware handcrafted features (e.g., Local Binary Pattern) as discriminative information for the input of DNNs. However, the handcrafted feature extraction relies on experts' domain knowledge, and how to choose appropriate handcrafted features is underexplored. To this end, we propose a learnable network to extract Meta Pattern (MP) in our learning to learn framework. By replacing handcrafted features with the MP, the discriminative information from MP is capable of learning a more generalized model. Moreover, we devise a two stream network to hierarchically fuse the input RGB image and the extracted MP by using our proposed Hierarchical Fusion Module (HFM). We conduct comprehensive experiments and show that our MP outperforms the compared handcrafted features. Also, our proposed method with HFM and the MP can achieve state of the art performance on two different domain generalization evaluation benchmarks.


Hybrid Ant Swarm Based Data Clustering. Biologically inspired computing techniques are very effective and useful in many areas of research including data clustering. Ant clustering algorithm is a nature inspired clustering technique which is extensively studied for over two decades. In this study, we extend the ant clustering algorithm (ACA) to a hybrid ant clustering algorithm (hACA). Specifically, we include a genetic algorithm in standard ACA to extend the hybrid algorithm for better performance. We also introduced novel pick up and drop off rules to speed up the clustering performance. We study the performance of the hACA algorithm and compare with standard ACA as a benchmark.


Mean Covariance Robust Risk Measurement. We introduce a universal framework for mean covariance robust risk measurement and portfolio optimization. We model uncertainty in terms of the Gelbrich distance on the mean covariance space, along with prior structural information about the population distribution. Our approach is related to the theory of optimal transport and exhibits superior statistical and computational properties than existing models. We find that, for a large class of risk measures, mean covariance robust portfolio optimization boils down to the Markowitz model, subject to a regularization term given in closed form. This includes the finance standards, value at risk and conditional value at risk, and can be solved highly efficiently.


The even parity Goldfeld conjecture congruent number elliptic curves. In 1979 Goldfeld conjectured 50 of the quadratic twists of an elliptic curve defined over the rationals have analytic rank zero. In this expository article we present a few recent developments towards the conjecture, especially its first instance the congruent number elliptic curves.


A uniform ergodic theorem for some N "orlund means. We obtain a uniform ergodic theorem for the sequence frac1 s(n) sum k 0 n( varDelta s)(n k) ,T k , where varDelta is the inverse of the endomorphism on the vector space of scalar sequences which maps each sequence into the sequence of its partial sums, T is a bounded linear operator on a Banach space and s is a divergent nondecreasing sequence of strictly positive real numbers, such that lim n rightarrow infty s(n 1) s(n) 1 and varDelta qs in ell 1 for some positive integer q . Indeed, we prove that if T n s(n) converges to zero in the uniform operator topology, then the sequence of averages above converges in the same topology if and only if 1 is either in the resolvent set of T , or a simple pole of the resolvent function of T .


Post Quantum Security for Ultra Reliable Low Latency Heterogeneous Networks. We consider the problem of post quantum secure and ultra reliable communication through a heterogeneous network consisting of multiple connections. Three performance metrics are considered security, throughput, and in order delivery delay. In this setting, previous work has looked, individually, at the trade offs between in order delivery delay and throughput, and between security and throughput. This is the first work considering the trade off between all three for heterogeneous communication networks, while taking the computational complexity into account. We present LL HUNCC, a low latency hybrid universal network coding cryptosystem. LL HUNCC is an efficient coding scheme which allows for secure communications over a noisy untrusted heterogeneous network by encrypting only a small part of the information being sent. This scheme provides post quantum security with high throughput and low in order delivery delay guarantees. We evaluate LL HUNCC via simulations on a setting inspired by a practical scenario for heterogeneous communications involving a satellite communication link and a 5G communication network. Under this scenario, we compare LL HUNCC to the state of the art where all communication paths are encrypted via a post quantum public key cryptosystem.


Ahlfors Weill extensions for harmonic mappings. We provide two new formulas for quasiconformal extension to overline mathbb C for harmonic mappings defined in the unit disk and having sufficiently small Schwarzian derivative. Both are generalizations of the Ahlfors Weill extension for holomorphic functions.


DCG Distributed Conjugate Gradient for Efficient Linear Equations Solving. Distributed algorithms to solve linear equations in multi agent networks have attracted great research attention and many iteration based distributed algorithms have been developed. The convergence speed is a key factor to be considered for distributed algorithms, and it is shown dependent on the spectral radius of the iteration matrix. However, the iteration matrix is determined by the network structure and is hardly pre tuned, making the iterative based distributed algorithms may converge very slowly when the spectral radius is close to 1. In contrast, in centralized optimization, the Conjugate Gradient (CG) is a widely adopted idea to speed up the convergence of the centralized solvers, which can guarantee convergence in fixed steps. In this paper, we propose a general distributed implementation of CG, called DCG. DCG only needs local communication and local computation, while inheriting the characteristic of fast convergence. DCG guarantees to converge in 4Hn rounds, where H is the maximum hop number of the network and n is the number of nodes. We present the applications of DCG in solving the least square problem and network localization problem. The results show the convergence speed of DCG is three orders of magnitude faster than the widely used Richardson iteration method.


Anomaly Detection in Beehives An Algorithm Comparison. Sensor equipped beehives allow monitoring the living conditions of bees. Machine learning models can use the data of such hives to learn behavioral patterns and find anomalous events. One type of event that is of particular interest to apiarists for economical reasons is bee swarming. Other events of interest are behavioral anomalies from illness and technical anomalies, e.g. sensor failure. Beekeepers can be supported by suitable machine learning models which can detect these events. In this paper we compare multiple machine learning models for anomaly detection and evaluate them for their applicability in the context of beehives. Namely we employed Deep Recurrent Autoencoder, Elliptic Envelope, Isolation Forest, Local Outlier Factor and One Class SVM. Through evaluation with real world datasets of different hives and with different sensor setups we find that the autoencoder is the best multi purpose anomaly detector in comparison.


Similarity for zero square matrices. Let T be an n by n zero square matrix over a commutative unital ring R. We show that T is similar to a multiple of E 1n if R is a GCD domain and n 2, if R is a GCD domain with 2 not zero divisor and n 3, but there are matrices which are not similar to any multiple of E 1n whenever n greater or equal 4, over any commutative unital ring.


Can We Trust Tests To Automate Dependency Updates? A Case Study of Java Projects. Developers are increasingly using services such as Dependabot to automate dependency updates. However, recent research has shown that developers perceive such services as unreliable, as they heavily rely on test coverage to detect conflicts in updates. To understand the prevalence of tests exercising dependencies, we calculate the test coverage of direct and indirect uses of dependencies in 521 well tested Java projects. We find that tests only cover 58 of direct and 20 of transitive dependency calls. By creating 1,122,420 artificial updates with simple faults covering all dependency usages in 262 projects, we measure the effectiveness of test suites in detecting semantic faults in dependencies we find that tests can only detect 47 of direct and 35 of indirect artificial faults on average. To increase reliability, we investigate the use of change impact analysis as a means of reducing false negatives on average, our tool can uncover 74 of injected faults in direct dependencies and 64 for transitive dependencies, nearly two times more than test suites. We then apply our tool in 22 real world dependency updates, where it identifies three semantically conflicting cases and five cases of unused dependencies. Our findings indicate that the combination of static and dynamic analysis should be a requirement for future dependency updating systems.


Model predictive control guided with optimal experimental design for pulse based parallel cultivation. Optimal experimental design for parameter precision attempts to maximize the information content in experimental data for a most effective identification of parametric model. With the recent developments in miniaturization and parallelization of cultivation platforms for high throughput screening of optimal growth conditions massive amounts of informative data can be generated with few experiments. Increasing the quantity of the data means to increase the number of parameters and experimental design variables which might deteriorate the identifiability and hamper the online computation of optimal inputs. To reduce the problem complexity, in this work, we introduce an auxiliary controller at a lower level that tracks the optimal feeding strategy computed by a high level optimizer in an online fashion. The hierarchical framework is especially interesting for the operation under constraints. The key aspect of this method are discussed together with an in silico study considering parallel glucose limited bacterial fed batch cultivations.


Regularity and amenability of weighted Banach algebras and their second dual on locally compact groups. Let omega be a weight function on a locally compact group G mand let M (G, omega ) be the subspace of M(G , omega ) consisting of all functionals that vanish at infinity. In this paper, we first investigate the Arens regularity of M (G, omega ) and show that M (G, omega ) is Arnes regular if and only if G is finite or omega is zero cluster. This result is an answer to the question posed and it improves some well known results. We also give necessary and sufficient criteria for the weight function spaces Wap(G , 1 omega ) and Wap(G , 1 omega ) to be equal to C b (G , 1 omega ) . We prove that for non compact group G, the Banach algebra M (G, omega ) is Arnes regular if and only if Wap(G , 1 omega ) C b (G , 1 omega ) . We then investigate amenability of M (G, omega ) and prove that M (G, omega ) is amenable and Arnes regular if and only if G is finite.


TopicRefine Joint Topic Prediction and Dialogue Response Generation for Multi turn End to End Dialogue System. A multi turn dialogue always follows a specific topic thread, and topic shift at the discourse level occurs naturally as the conversation progresses, necessitating the model's ability to capture different topics and generate topic aware responses. Previous research has either predicted the topic first and then generated the relevant response, or simply applied the attention mechanism to all topics, ignoring the joint distribution of the topic prediction and response generation models and resulting in uncontrollable and unrelated responses. In this paper, we propose a joint framework with a topic refinement mechanism to learn these two tasks simultaneously. Specifically, we design a three pass iteration mechanism to generate coarse response first, then predict corresponding topics, and finally generate refined response conditioned on predicted topics. Moreover, we utilize GPT2DoubleHeads and BERT for the topic prediction task respectively, aiming to investigate the effects of joint learning and the understanding ability of GPT model. Experimental results demonstrate that our proposed framework achieves new state of the art performance at response generation task and the great potential understanding capability of GPT model.


Simulations for novel problems in recommendation analyzing misinformation and data characteristics. In this position paper, we discuss recent applications of simulation approaches for recommender systems tasks. In particular, we describe how they were used to analyze the problem of misinformation spreading and understand which data characteristics affect the performance of recommendation algorithms more significantly. We also present potential lines of future work where simulation methods could advance the work in the recommendation community.


Extracting Optimal Explanations for Ensemble Trees via Logical Reasoning. Ensemble trees are a popular machine learning model which often yields high prediction performance when analysing structured data. Although individual small decision trees are deemed explainable by nature, an ensemble of large trees is often difficult to understand. In this work, we propose an approach called optimised explanation (OptExplain) that faithfully extracts global explanations of ensemble trees using a combination of logical reasoning, sampling and optimisation. Building on top of this, we propose a method called the profile of equivalent classes (ProClass), which uses MAX SAT to simplify the explanation even further. Our experimental study on several datasets shows that our approach can provide high quality explanations to large ensemble trees models, and it betters recent top performers.


Detecting Compliance of Privacy Policies with Data Protection Laws. Privacy Policies are the legal documents that describe the practices that an organization or company has adopted in the handling of the personal data of its users. But as policies are a legal document, they are often written in extensive legal jargon that is difficult to understand. Though work has been done on privacy policies but none that caters to the problem of verifying if a given privacy policy adheres to the data protection laws of a given country or state. We aim to bridge that gap by providing a framework that analyzes privacy policies in light of various data protection laws, such as the General Data Protection Regulation (GDPR). To achieve that, firstly we labeled both the privacy policies and laws. Then a correlation scheme is developed to map the contents of a privacy policy to the appropriate segments of law that a policy must conform to. Then we check the compliance of privacy policy's text with the corresponding text of the law using NLP techniques. By using such a tool, users would be better equipped to understand how their personal data is managed. For now, we have provided a mapping for the GDPR and PDPA, but other laws can easily be incorporated in the already built pipeline.


Tip induced strain, bandgap, and radiative decay engineering of a single metal halide perovskite quantum dot. Strain engineering of perovskite quantum dots (pQDs) enables widely tunable photonic device applications. However, manipulation at the single emitter level has never been attempted. Here, we present a tip induced control approach combined with tip enhanced photoluminescence (TEPL) spectroscopy to engineer strain, bandgap, and emission quantum yield of a single pQD. Single CsPbBr x I 3 x pQDs are clearly resolved through hyperspectral TEPL imaging with sim 10 nm spatial resolution. The plasmonic tip then directly applies pressure to a single pQD to facilitate a bandgap shift up to sim 62 meV with Purcell enhanced PL quantum yield as high as sim 10 5 for the strain induced pQD. Furthermore, by systematically modulating the tip induced compressive strain of a single pQD, we achieve dynamical bandgap engineering in a reversible manner. In addition, we facilitate the quantum dot coupling for a pQD ensemble with sim 0.8 GPa tip pressure at the nanoscale. Our approach presents a new strategy to tune the nano opto electro mechanical properties of pQDs at the single crystal level.


Wireless Charging Power Side Channel Attacks. This paper shows that today's wireless charging interface is vulnerable to power side channel attacks a smartphone charging wirelessly leaks private information about its activity to the wireless charger (charging transmitter). We present a website fingerprinting attack through the wireless charging side channel for both iOS and Android devices. The attack monitors the current drawn by the wireless charging transmitter while 20 webpages from the Alexa top sites list are loaded on a charging smartphone. We implement a classifier that correctly identifies unlabeled current traces with an accuracy of 87 on average for an iPhone 11 and 95 on average for a Google Pixel 4. This represents a considerable security threat because wireless charging does not require any user permission if the phone is within the range of a charging transmitter. To the best of our knowledge, this work represents the first to introduce and demonstrate a power side channel attack through wireless charging. Additionally, this study compares the wireless charging side channel with the wired USB charging power side channel, showing that they are comparable. We find that the performance of the attack deteriorates as the contents of websites change over time. Furthermore, we discover that the amount of information leakage through both wireless and wired charging interfaces heavily depends on the battery level minimal information is leaked at low battery levels.


Searching for a source without gradients how good is infotaxis and how to beat it. Infotaxis is a popular search algorithm designed to track a source of odor in a turbulent environment using information provided by odor detections. To exemplify its capabilities, the source tracking task was framed as a partially observable Markov decision process consisting in finding, as fast as possible, a stationary target hidden in a 2D grid using stochastic partial observations of the target location. Here we provide an extended review of infotaxis, together with a toolkit for devising better strategies. We first characterize the performance of infotaxis in domains from 1D to 4D. Our results show that, while being suboptimal, infotaxis is reliable (the probability of not reaching the source approaches zero), efficient (the mean search time scales as expected for the optimal strategy), and safe (the tail of the distribution of search times decays faster than any power law, though subexponentially). We then present three possible ways of beating infotaxis, all inspired by methods used in artificial intelligence tree search, heuristic approximation of the value function, and deep reinforcement learning. The latter is able to find, without any prior human knowledge, the (near) optimal strategy. Altogether, our results provide evidence that the margin of improvement of infotaxis toward the optimal strategy gets smaller as the dimensionality increases.


Content Based Textual File Type Detection at Scale. Programming language detection is a common need in the analysis of large source code bases. It is supported by a number of existing tools that rely on several features, and most notably file extensions, to determine file types. We consider the problem of accurately detecting the type of files commonly found in software code bases, based solely on textual file content. Doing so is helpful to classify source code that lack file extensions (e.g., code snippets posted on the Web or executable scripts), to avoid misclassifying source code that has been recorded with wrong or uncommon file extensions, and also shed some light on the intrinsic recognizability of source code files. We propose a simple model that (a) use a language agnostic word tokenizer for textual files, (b) group tokens in 1 2 grams, (c) build feature vectors based on N gram frequencies, and (d) use a simple fully connected neural network as classifier. As training set we use textual files extracted from GitHub repositories with at least 1000 stars, using existing file extensions as ground truth. Despite its simplicity the proposed model reaches 85 in our experiments for a relatively high number of recognized classes (more than 130 file types).


Weak Signals in the Mobility Landscape Car Sharing in Ten European Cities. Car sharing is one the pillars of a smart transportation infrastructure, as it is expected to reduce traffic congestion, parking demands and pollution in our cities. From the point of view of demand modelling, car sharing is a weak signal in the city landscape only a small percentage of the population uses it, and thus it is difficult to study reliably with traditional techniques such as households travel diaries. In this work, we depart from these traditional approaches and we leverage web based, digital records about vehicle availability in 10 European cities for one of the major active car sharing operators. We discuss which sociodemographic and urban activity indicators are associated with variations in car sharing demand, which forecasting approach (among the most popular in the related literature) is better suited to predict pickup and drop off events, and how the spatio temporal information about vehicle availability can be used to infer how different zones in a city are used by customers. We conclude the paper by presenting a direct application of the analysis of the dataset, aimed at identifying where to locate maintenance facilities within the car sharing operation area.


Potential Singularity Formation of 3D Axisymmetric Navier Stokes Equations with Degenerate Diffusion Coefficients. In this paper, we present strong numerical evidences that the 3 D incompressible axisymmetric Navier Stokes equations with degenerate diffusion coefficients and smooth initial data of finite energy develop a potential finite time locally self similar singularity at the origin. The spatial part of the degenerate diffusion coefficient is a smooth function of r and z independent of the solution and vanishes like O(r 2) O(z 2) near the origin. This potential singularity is induced by a potential singularity of the 3 D Euler equations. An important feature of this potential singularity is that the solution develops a two scale traveling wave that travels towards the origin. The two scale feature is characterized by the property that the center of the traveling wave approaches the origin at a slower rate than the rate of the collapse of the singularity. The driving mechanism for this potential singularity is due to two antisymmetric vortex dipoles that generate a strong shearing layer in both the radial and axial velocity fields. Without the viscous regularization, the 3 D Euler equations develop an additional small scale characterizing the thickness of the sharp front. On the other hand, the Navier Stokes equations with a constant diffusion coefficient regularize the two scale solution structure and do not develop a finite time singularity for the same initial data. The initial condition is designed in such a way that it generates a positive feedback loop that enforces a strong nonlinear alignment of vortex stretching, leading to a stable locally self similar blowup at the origin. We perform careful resolution study and asymptotic scaling analysis to provide further support of the potential finite time locally self similar blowup.


The Transport Oka Grauert Principle for Simple Surfaces. This article considers the attenuated transport equation on Riemannian surfaces in the light of a novel twistor correspondence under which matrix attenuations correspond to holomorphic vector bundles on a complex surface. The main result is a transport version of the classical Oka Grauert principle and states that the twistor space of a simple surface supports no nontrivial holomorphic vector bundles. This solves an open problem on the existence of matrix holomorphic integrating factors on simple surfaces and is applied to give a range characterisation for the non Abelian X ray transform. The main theorem is proved using the inverse function theorem of Nash and Moser and the required tame estimates are obtained from recent results on the injectivity of attenuated X ray transforms and microlocal analysis of the associated normal operators.


Reliability Aware Quantization for Anti Aging NPUs. Transistor aging is one of the major concerns that challenges designers in advanced technologies. It profoundly degrades the reliability of circuits during its lifetime as it slows down transistors resulting in errors due to timing violations unless large guardbands are included, which leads to considerable performance losses. When it comes to Neural Processing Units (NPUs), where increasing the inference speed is the primary goal, such performance losses cannot be tolerated. In this work, we are the first to propose a reliability aware quantization to eliminate aging effects in NPUs while completely removing guardbands. Our technique delivers a graceful inference accuracy degradation over time while compensating for the aging induced delay increase of the NPU. Our evaluation, over ten state of the art neural network architectures trained on the ImageNet dataset, demonstrates that for an entire lifetime of 10 years, the average accuracy loss is merely 3 . In the meantime, our technique achieves 23 higher performance due to the elimination of the aging guardband.


On adjoint Bloch Kato Selmer groups and adjoint p adic L functions for mathrm GSp 2g . In this paper, we complete our previous work about the pairing on the cuspidal eigenvariety associated with mathrm GSp 2g . More precisely, we (conjecturally) justify the terminology of adjoint p adic L function' defined in our previous work. Our strategy is based on the study of families of Galois representations on the cuspidal eigenvariety associated with mathrm GSp 2g , linking the adjoint p adic L function with the adjoint Bloch Kato Selmer group. Such a strategy is inspired by the book of J. Bella "iche and G. Chenevier.


Revisiting Driver Anonymity in ORide. Ride Hailing Services (RHS) have become a popular means of transportation, and with its popularity comes the concerns of privacy of riders and drivers. ORide is a privacy preserving RHS proposed at the USENIX Security Symposium 2017 and uses Somewhat Homomorphic Encryption (SHE). In their protocol, a rider and all drivers in a zone send their encrypted coordinates to the RHS Service Provider (SP) who computes the squared Euclidean distances between them and forwards them to the rider. The rider decrypts these and selects the optimal driver with least Euclidean distance. In this work, we demonstrate a location harvesting attack where an honest but curious rider, making only a single ride request, can determine the exact coordinates of about half the number of responding drivers even when only the distance between the rider and drivers are given. The significance of our attack lies in inferring locations of other drivers in the zone, which are not (supposed to be) revealed to the rider as per the protocol. We validate our attack by running experiments on zones of varying sizes in arbitrarily selected big cities. Our attack is based on enumerating lattice points on a circle of sufficiently small radius and eliminating solutions based on conditions imposed by the application scenario. Finally, we propose a modification to ORide aimed at thwarting our attack and show that this modification provides sufficient driver anonymity while preserving ride matching accuracy.


Mindless Attractor A False Positive Resistant Intervention for Drawing Attention Using Auditory Perturbation. Explicitly alerting users is not always an optimal intervention, especially when they are not motivated to obey. For example, in video based learning, learners who are distracted from the video would not follow an alert asking them to pay attention. Inspired by the concept of Mindless Computing, we propose a novel intervention approach, Mindless Attractor, that leverages the nature of human speech communication to help learners refocus their attention without relying on their motivation. Specifically, it perturbs the voice in the video to direct their attention without consuming their conscious awareness. Our experiments not only confirmed the validity of the proposed approach but also emphasized its advantages in combination with a machine learning based sensing module. Namely, it would not frustrate users even though the intervention is activated by false positive detection of their attentive state. Our intervention approach can be a reliable way to induce behavioral change in human AI symbiosis.


Maximum Entropy Multi Agent Dynamic Games Forward and Inverse Solutions. In this paper, we study the problem of multiple stochastic agents interacting in a dynamic game scenario with continuous state and action spaces. We define a new notion of stochastic Nash equilibrium for boundedly rational agents, which we call the Entropic Cost Equilibrium (ECE). We show that ECE is a natural extension to multiple agents of Maximum Entropy optimality for single agents. We solve both the "forward" and "inverse" problems for the multi agent ECE game. For the forward problem, we provide a Riccati algorithm to compute closed form ECE feedback policies for the agents, which are exact in the Linear Quadratic Gaussian case. We give an iterative variant to find locally ECE feedback policies for the nonlinear case. For the inverse problem, we present an algorithm to infer the cost functions of the multiple interacting agents given noisy, boundedly rational input and state trajectory examples from agents acting in an ECE. The effectiveness of our algorithms is demonstrated in a simulated multi agent collision avoidance scenario, and with data from the INTERACTION traffic dataset. In both cases, we show that, by taking into account the agents' game theoretic interactions using our algorithm, a more accurate model of agents' costs can be learned, compared with standard inverse optimal control methods.


Low rank approximation for multiscale PDEs. Historically, analysis for multiscale PDEs is largely unified while numerical schemes tend to be equation specific. In this paper, we propose a unified framework for computing multiscale problems through random sampling. This is achieved by incorporating randomized SVD solvers and manifold learning techniques to numerically reconstruct the low rank features of multiscale PDEs. We use multiscale radiative transfer equation and elliptic equation with rough media to showcase the application of this framework.